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(54) Television receiver, video signal processing device, image processing method and device 



(57) The television receiver including a display 
device capable of displaying a video signal having a 
predetermined display format of this invention includes: 
a plurality of video signal sources; a selection circuit for 
selecting one of a plurality of video signals output from 
the plurality of video signal sources; and an image proc- 



essor for converting a format of the video signal 
selected by the selection circuit into the predetermined 
display format, wherein a video signal output from the 
processor is supplied to the display device. 
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Description 

BACKGROUND OF THE INVENTION 

1. FIELD OF THE INVENTION: 

[0001] The present invention relates to a television 
receiver, a video signal processing device, an image 
processing device, and an image processing method. 

2. DESCRIPTION OF THE RELATED ART: 

[0002] In recent years, the methods of broadcasting 
television signals have been diversified. For instance, 
not only have NTSC (National Television System Com- 
mittee) signals been broadcasted using a ground wave 
but also both NTSC signals and high-definition signals 
have been broadcasted using a broadcasting satellite 
(BS). Further, just recently, digital signals have been 
broadcasted using a communication satellite (CS). 
[0003] With the diversified methods of broadcasting, 
television receivers are demanded to have a capability 
of receiving various types of signals from such diversi- 
fied broadcasting methods to display corresponding 
images. 

[0004] Each of the different broadcasting methods 
uses a video format which is different from one another. 
For example, the NTSC signal broadcasting uses a 
video format of 525 horizontal scanning lines/interlace 
scanning, while the high-definition signal broadcasting 
uses a video format of 1125 horizontal scanning 
lines/interlace scanning. Further, in recent years, televi- 
sion receivers have been requested to display video sig- 
nals having video formats of VGA (video graphics array) 
and SVGA (super VGA) which are output from comput- 
ers. As such, the demands on the display function of tel- 
evision receivers have increasingly become strong. 
[0005] When a television receiver capable of display- 
ing video signals having a variety of video formats is 
attempted to be realized, one may consider providing 
different conversion devices for input signals having dif- 
ferent image formats. Such a configuration, however, 
requires the same number of conversion devices as that 
of the possible different image formats, thereby increas- 
ing the circuit size and the cost. 
[0006] A conventional image processing device for 
performing digital image processing for video signals 
such as television signals is shown in Figure 26. Refer- 
ring to Figure 26, the image processing device includes 
a digital signal processing circuit 2200 constructed to 
perform a predetermined image processing for video 
signals and at least one field memory and/or frame 
memory 2202. 

[0007] In the case of a moving-image real-time 
processing, for example, a frame memory 2202A and a 
field memory 2202B are used for motion detection, 
while a frame memory 2202C is used for motion adap- 
tion interpolation. An additional frame memory (not 



shown) may be used for time-axis conversion for con- 
verting a high-definition signal into an NTSC signal, for 
example. 

[0008] Thus, a conventional digital image processing 
5 circuit needs more field memories or frame memories 
as more types of image processing are required. This is 
disadvantageous in the aspects of reducing the cost 
and size of the device. Dynamic random access memo- 
ries (DRAMs) having a capacity of 1 to 2 M bits are used 
10 for general type field memories and frame memories. 
These DRAMs are extremely small in memory capacity 
compared with presently mainstream 16M-bit and 64M- 
bit dynamic RAMs, but are not so different in cost and 
chip size from the latter. 
15 [0009] As the number of field memories and/or frame 
memories increases, the number of terminal pins of the 
digital signal processing circuit 2200 increases propor- 
tionally, thereby increasing the size of the resultant IC 
package. 

20 [0010] Another problem is that the system with the 
above configuration is poorly adaptive to a variety of 
applications. For example, a system constructed for the 
NTSC signal using field memories having a capacity of 
1 .5 M bits is not used for the high-definition signal which 

25 needs field memories having a capacity of about 4 M 
bits. 

[001 1 ] Moreover, the usage of each of such a number 
of field memories and/or frame memories is restricted or 
specified in accordance with functions defined by a 
30 processing section of the digital signal processing cir- 
cuit 2200. Such a conventional image processing 
device therefore generally fails to be used for a variety 
of applications. 

[0012] Conventionally, therefore, when one television 
35 receiver is intended to receive a variety of video signals 
such as an NTSC signal, a BS signal, a high-definition 
signal, and a signal output from a computer, it is 
required to incorporate all of the different types of digital 
signal processing circuits, together with relevant 
40 field/frame memories, exclusive for respective types of 
video signals. The resultant device is extremely high in 
cost and large in size. 

[0013] In addition to the current demands being 
placed on the digital signal processing circuitry, with the 

45 onset of digital broadcasting and the enhancement of 
the broadcasting image quality, a video signal process- 
ing circuit incorporated in a television receiver and the 
like similarly has been demanded to have a function of 
processing video signals having different formats. More- 

50 over, such a video signal processing circuit has been 
demanded to have a function of displaying as much 
information as possible simultaneously, such as a dou- 
ble-screen display and a multi-screen display. Under 
these circumstances, a single-instruction multiple-data 

55 (SIMD) type video signal processor has been used as 
the video signal processing circuit. 
[0014] The SIMD video signal processor processes a 
video signal for each horizontal scanning line, and 
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includes N processor elements PE 1 to PE N wherein N is 
an integer more than the number of effective pixels con- 
nected to one horizontal scanning line. Each of the N 
processor elements PE 1 to PE N processes video data 
corresponding to one of the pixels connected to one 
horizontal scanning line. 

[0015] Figure 32 illustrates a configuration of a con- 
ventional video signal processor 3100. The video signal 
processor 3100 includes a data input register 3101 , an 
operator 3102, and a data output register 3105. 
[0016] The data input register 3101 outputs a plurality 
of serially input video data units to the operator 3102 in 
parallel. The data input register 3101 has a width of s 
bits and a depth of N words. The bit width s of the data 
input register 3101 is larger than a bit width of a general 
video signal to be processed. This is because there 
arises instances where a current luminance signal and 
a luminance signal delayed by one field must be input 
into the data input register 3101 simultaneously, for 
example. 

[0017] The operator 3102 performs a predetermined 
arithmetic operation for the plurality of video data units 
output from the data input register 3101 in parallel. The 
operator 3102 includes N processor elements PE i to 
PE N . Each of the processor elements PE 1 to PE N 
includes a small-capacity memory 31 03 which holds the 
input data and operation results and an operating ele- 
ment 3104 which performs a predetermined signal 
processing operation. 

[0018] The data output register 3105 outputs the plu- 
rality of video data units processed by the operator 31 02 
in series. The data output register 3105 has a width of t 
bits and a depth of N words. The bit width t of the data 
output register 3105 is also larger than a bit width of a 
general video signal to be processed. This is because 
there arises instances where an output video signal and 
data relating to a motion delayed by one field must be 
output from the data output register 3105 simultane- 
ously, for example. 

[0019] Hereinbelow, the operation of the video signal 
processor 3100 will be described, taking as an example 
a process of removing a horizontal high frequency band 
component included in a video signal, i.e., a processing 
of performing horizontal low-pass filtering for a video 
signal (hereinbelow, referred to as an LPF processing). 
[0020] Figure 33 illustrates operations of the data 
input register 31 01 , the operator 31 02, and the data out- 
put register 3105 in the LPF processing. In Figure 33, 
the x-axis represents the time. 
[0021] The video signal processor 3100 operates in 
accordance with a horizontal synchronous signal which 
defines horizontal blanking periods and effective video 
periods as shown in Figure 33. 
[0022] During an effective video period Pj, a plurality 
of video data units corresponding to a plurality of effec- 
tive images connected to one horizontal scanning lines 
are input into the data input register 3101 in series. For 
example, one horizontal scanning line may be the i-th 



horizontal scanning line. Hereinbelow, the i-th horizontal 
scanning line is referred to as the i line wherein i is an 
arbitrary integer. 

[0023] During a horizontal blanking period Bj following 
5 the effective video period Pj, the plurality of video data 
units corresponding to the i line input into the data input 
register 3101 are transferred to the operator 3102 in 
parallel. 

[0024] During an effective video period P i+1 following 
10 the horizontal blanking period Bj, the LPF processing is 
performed for the plurality of video data units corre- 
sponding the i line. 

[0025] During a horizontal blanking period B i+i follow- 
ing the effective video period P i+i , a plurality of LPF- 
15 processed video data units corresponding to the i line 
are transferred to the data output register 31 05 in paral- 
lel. 

[0026] During an effective video period P i+2 (not 
shown in Figure 33) following the horizontal blanking 

20 period B i+1 , the plurality of LPF-processed video data 
units corresponding the i line are output from the data 
output register 3105 in series. 
[0027] The above-described process is also per- 
formed for a plurality of video data units corresponding 

25 to an (i-1) line and a plurality of video data units corre- 
sponding to an (i+1) line. 

[0028] Figure 34 diagrammatically illustrates the LPF 
processing performed by the operator 3102. In Figure 
34, the operator 3102 is shown to perform the LPF 
30 processing for video data units Dj. 2 , D^, Dj, D j+1 , D J+2 
corresponding to the i line, and output LPF-processed 
video data units D'j_ 2 , D'^, D'j, D'j +1 , D'j +2 correspond- 
ing to the i line. 

[0029] The LPF-processed video data unit D'j is 
35 obtained by the calculation of expression (1) below: 

DV = 1/4 • D H + 1/2 • Dj + 1/4 • D j+1 (1) 

[0030] The calculation of expression (1) is performed 
40 by the processor element PEj. Similar calculations to 
that of expression (1) are performed by the processor 
elements PEj_ 2 , PE^, PE j+1 , PE j+2 . Only one LPF 
processing is performed by each of the processor ele- 
ments PEj_ 2 , PEj^, PEj, PEj +1 , PEj +2 for one line. In this 
45 way, the LPF-processed video data units D'j_ 2 , D'^, D'j, 
D f j +1 , D f j +2 corresponding to the i line are obtained. 
[0031] Thus, as described above, a plurality of video 
data units corresponding to one horizontal scanning line 
can be processed using a video signal processor includ- 
50 ing the number of processor elements equal to or more 
than the number of effective pixels connected to one 
horizontal scanning line. 

[0032] In order to make video apparatuses such as 
television receivers more prevailing, further cost reduc- 
55 tion of the video signal processor, as well as the sophis- 
tication thereof, are essential. 
[0033] In the above-described conventional video sig- 
nal processor, however, if the number of processor ele- 
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merits included in the video signal processor is smaller 
than the number of effective pixels connected to one 
horizontal scanning line, video data units corresponding 
to the effective pixels which have no corresponding 
processor elements fail to be processed. To avoid this 5 
problem, the number of processor elements included in 
the video signal processor must be increased as the 
number of effective pixels connected to one horizontal 
scanning line increases. This causes an increase in the 
cost of the video signal processor when the processing w 
of high-precision video signals is involved. 

SUMMARY OF THE INVENTION 

[0034] The television receiver including a display is 
device capable of displaying a video signal having a 
predetermined display format of this invention includes: 
a plurality of video signal sources; a selection circuit for 
selecting one of a plurality of video signals output from 
the plurality of video signal sources; and an image proc- 20 
essor for converting a format of the video signal 
selected by the selection circuit into the predetermined 
display format, wherein a video signal output from the 
processor is supplied to the display device. 
[0035] In one embodiment of the invention, each of 25 
the plurality of video signal sources includes at least 
one of an NTSC decoder, a MUSE decoder, and a dig- 
ital decoder. 

[0036] Alternatively, the television receiver including a 
display device capable of displaying a video signal hav- 30 
ing a predetermined display format of this invention 
includes: a plurality of video signal sources; a selection 
circuit for selecting at least two of a plurality of video sig- 
nals output from the plurality of video signal sources; 
and an image processor for converting a format of each 35 
of the at least two video signals selected by the selec- 
tion circuit into a predetermined display format, and 
processing the at least two video signals so that synthe- 
sized images are displayed on the display device, 
wherein a video signal output from the processor is sup- 40 
plied to the display device. 

[0037] In one embodiment of the invention, each of 
the plurality of video signal sources includes at least 
one of an NTSC decoder, a MUSE decoder, and a dig- 
ital decoder. 45 
[0038] According to another aspect of the invention, a 
video signal processing apparatus is provided. The 
video signal processing apparatus includes: a plurality 
of video signal input terminals for receiving a plurality of 
video signals; a selection circuit for selecting one of the so 
plurality of video signals input via the plurality of video 
signal input terminals; and an image processor for con- 
verting a format of the video signal selected by the 
selection circuit into a predetermined display format. 
[0039] Alternatively, the video signal processing appa- 55 
ratus of this invention includes: a plurality of video signal 
input terminals for receiving a plurality of video signals; 
a selection circuit for selecting at least two of the plural- 



ity of video signals input via the plurality of video signal 
input terminals; and an image processor for converting 
a format of each of the at least two video signals 
selected by the selection circuit into a predetermined 
display format, and synthesizing the at least two video 
signals. 

[0040] According to still another aspect of the inven- 
tion, an image processing device is provided. The 
image processing device includes: an input section for 
receiving image data to be processed; a digital signal 
processing section including a plurality of processing 
elements allocated to respective pixels corresponding 
to one scanning line in a one-to-one relationship for per- 
forming a same operation in accordance with a common 
instruction, the digital signal processing section receiv- 
ing, processing, and outputting the image data for each 
scanning line; an image memory having a fixed memory 
region and capable of performing a write operation and 
a road operation in parallel and independently, the 
image memory receiving and outputting the image data 
for each scanning line; an output section for outputting 
processed image data; data bus means for connecting 
the input section, the digital signal processing section, 
the image memory, and the output section with one 
another; and control means for controlling the input sec- 
tion, the digital signal processing section, the image 
memory, and the output section in accordance with pro- 
gram data. 

[0041] In one embodiment of the invention, the digital 
signal processing section includes: a data input portion 
for receiving in parallel for each scanning line at least 
one image data unit corresponding to at least one 
respective video signal; and a data output portion for 
outputting in parallel for each scanning line the at least 
one image data unit processed for each scanning line 
by the plurality of processing elements, wherein a data 
input operation for each scanning line by the data input 
portion, a processing operation for each scanning line 
by the plurality of processing elements, and a data out- 
put operation for each scanning line by the date output 
section are performed in a pipeline manner. 
[0042] In another embodiment of the invention, the 
image memory includes: data write means for sequen- 
tially writing the input image data into the memory 
region in sequential addresses; data read means for 
reading the image data to be output from the memory 
region in sequential addresses; and pointer control 
means for controlling a write pointer and a read pointer 
for indicating a write address and a read address in the 
memory region, respectively, in accordance with the 
program data. 

[0043] In still another embodiment of the invention, the 
image memory further includes: a plurality of input buff- 
ers each having at least first and second input buffer 
portions with a respective predetermined memory 
capacity; and means for controlling the plurality of input 
buffers such that when the first input buffer portion of the 
input buffer is filled with image data, writing of input 
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image data into the second input buffer portion is 
started, and image data is read from the first input buffer 
portion to be written into the memory region, and when 
the second input buffer portion is filled with image data, 
writing of input image data into the first input buffer por- 
tion is started, and image data is read from the second 
input buffer portion to be written into the memory region. 
[0044] In still another embodiment of the invention, a 
data rate at which image data is written into the memory 
region from the input buffer is selected to be different 
from a data rate at which image data is written into the 
input buffer. 

[0045] In still another embodiment of the invention, the 
image memory further includes: a plurality of output 
buffers each having at least first and second output 
buffer portions with a respective predetermined mem- 
ory capacity; and means for controlling the plurality of 
output buffers such that when the first output buffer por- 
tion of the output buffer has no image data, reading of 
image data from the second output buffer portion is 
started, and image data read from the memory region is 
written into the first output buffer portion, and when the 
second output buffer portion has no image data, reading 
of image data from the first output buffer portion is 
started, and image data read from the memory region is 
written into the second output buffer portion. 
[0046] In still another embodiment of the invention, a 
data rate at which image data is written into the output 
buffer from the memory region is selected to be different 
from a data rate at which image data is read from the 
output buffer. 

[0047] In still another embodiment of the invention, the 
data bus means includes: a first data bus portion for 
electrically connecting a data output terminal of the 
input section with a data input terminal of the digital sig- 
nal processing section; a second data bus portion for 
electrically connecting a data output terminal of the 
input section with a data input terminal of the image 
memory; a third data bus portion for electrically con- 
necting a data output terminal of the digital signal 
processing section with a data input terminal of the 
image memory; a fourth data bus portion for electrically 
connecting a data output terminal of the image memory 
with a data input terminal of the digital signal processing 
section; a fifth data bus portion for electrically connect- 
ing a data output terminal of the input section with a 
data input terminal of the output section; a sixth data 
bus portion for electrically connecting a data output ter- 
minal of the digital signal processing section with a data 
input terminal of the output section; and a seventh data 
bus portion for electrically connecting a data output ter- 
minal of the image memory with a data input terminal of 
the output section. 

[0048] In still another embodiment of the invention, all 
of the first to seventh data bus portions are formed on a 
semiconductor chip. 

[0049] In still another embodiment of the invention, the 
control moans includes: program data holding means 



for holding program data defining operation modes for 
the input section, the digital signal processing section, 
the image memory, the output section, and the data bus 
means; and program data distribution means for receiv- 

5 ing program data and distributing the program data into 
the program data holding means. 
[0050] According to still another aspect of the inven- 
tion, an image processing method for processing image 
data by the image processing device is provided. The 

10 method includes the steps of: receiving image data cor- 
responding to one video signal by the input section; per- 
forming a first processing for the image data output from 
the input section to the digital signal processing section 
by the digital signal processing section; writing the 

15 image data output from the digital signal processing 
section after the first processing into the image memory 
to temporarily store the image data in the image mem- 
ory; and receiving the image data read from the image 
memory by the digital signal processing section again to 

20 perform a second processing. 

[0051] In one embodiment of the invention, the image 
processing method further includes the steps of: writing 
the image data output from the digital signal processing 
section after the second processing into the image 

25 memory to temporarily store the image data in the 
image memory; and receiving the image data read from 
the image memory by the digital signal proceasing sec- 
tion again to perform a third processing. 
[0052] Alternatively, the image processing method for 

30 processing image data by the image processing device 
of this invention includes the steps of: receiving image 
data corresponding to one video signal by the input sec- 
tion; writing the image data output from the input section 
into the image memory to temporarily store the image 

35 data in the image memory; supplying the image data 
from the input section and the image data read from the 
image memory to the digital signal processing section in 
parallel, and performing a predetermined processing 
between these image data. 

40 [0053] In one embodiment of the invention, the image 
data is read from two output ports of the image memory 
by delaying the image data by a predetermined delay 
amount and input in parallel into the digital signal 
processing section, and the predetermined processing 

45 is performed between the two units of image data from 
the image memory and the image data from the input 
section. 

[0054] Alternatively, the image processing method for 
processing image data by the image processing device 

so of this invention includes the steps of: writing only a por- 
tion of the image data corresponding to a portion of pix- 
els for each scanning line and/or a portion of scanning 
lines for each field among the image data correspond- 
ing to one video signal into the image memory to tempo- 

55 rarily store the portion of the image data in the image 
memory; and reading from the image memory the 
image data in the order in which the pixels and scanning 
lines have been written to the image memory. 
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[0055] Alternatively, the image processing method for 
processing image data by the image processing device 
of this invention includes the steps of: writing image 
data corresponding to one video signal into the image 
memory to temporarily store the image data in the 5 
image memory; reading the image data from the image 
memory intermittently for each pixel or for each scan- 
ning line; and supplying the image data read from the 
image memory to the digital signal processing section, 
and interpolating image data at positions of pixels or w 
scanning lines which had been skipped in the intermit- 
tent reading of the image memory. 
[0056] Alternatively, the image processing method for 
processing image data by the image processing device 
of this invention includes the steps of: receiving first and 15 
second image data units corresponding to two image 
signals which ore asynchronous from each other by the 
input section; writing the first image data unit output 
from the input section into the image memory to tempo- 
rarily store the first image data in the image memory; 20 
supplying the second image data unit output from the 
input section to the digital signal processing section, 
and simultaneously reading the first image data unit 
from the image memory to supply to the digital signal 
processing section in synchronization with the supply of 25 
the second image data unit; and performing a predeter- 
mined processing for the first and second image data 
units input in synchronization with each other by the dig- 
ital signal processing section. 

[0057] Alternatively, the image processing method for 30 
processing image data by the image processing device 
of this invention includes the steps of: receiving first and 
second image data units corresponding to two image 
signals which are asynchronous from each other by the 
input section; supplying the first image data unit output 35 
from the input section to the digital signal processing 
section to perform a predetermined processing; supply- 
ing the first image data unit output from the digital signal 
processing section to the image memory, and simulta- 
neously supplying the second image data unit output 40 
from the input section to the image memory; and read- 
ing the first and second image data units from the image 
memory in synchronization with a synchronous signal 
other than synchronous signals relating to the first and 
second image data units. 45 
[0058] Alternatively, the image processing method for 
processing image data by the image processing device 
of this invention includes the steps of: receiving image 
data corresponding to one video signal by the input sec- 
tion; supplying a former half of the image data output 50 
from the input section to the digital signal processing 
section during a first period; writing the image data out- 
put from the input section into the image memory and 
reading the written image data after a predetermined 
delay time; and supplying a latter half of the image data 55 
output from the image memory to the digital signal 
processing section during a second period. 
[0059] In one embodiment of the invention, the image 



processing method further includes the steps of: writing 
the former half of the image data output from the digital 
signal processing section into the image memory and 
reading the written image data after a predetermined 
delay time; outputting the former half of the image data 
read from the image memory from the output section; 
outputting the latter half of the image data from the dig- 
ital signal processing section; and outputting the latter 
half of the image data output from the digital signal 
processing section from the output section in succes- 
sion with the former half of the image data. 
[0060] In another embodiment of the invention, the 
image processing method further includes the steps of: 
adding a first overlap portion which overlaps a head por- 
tion of the latter half of the image data by a predeter- 
mined number of pixels to a tail portion of the former half 
of the image data input into the digital signal processing 
section during the first period; adding a second overlap 
portion which overlaps a tail portion of the former half of 
the image data by a predetermined number of pixels to 
a head portion of the latter half of the image data input 
into the digital signal processing section during the sec- 
ond period; and removing the first end second overlap 
portions at a stage of outputting the image data outside 
from the output section. 

[0061 ] Alternatively, the image processing method for 
processing image data by the image processing device 
of this invention includes the steps of: receiving image 
date corresponding to one video signal by the input sec- 
tion end performing a low-pass filtering processing by 
the input section; and supplying the image data output 
from the input section to the digital signal processing 
section or the image memory, and performing a decima- 
tion processing for information compression of the 
image data. 

[0062] According to still another aspect of the inven- 
tion, a video signal processing device is provided. The 
video signal processing device includes: a first con- 
verter for receiving a plurality of video data units corre- 
sponding to a plurality of pixels connected to one 
scanning line as an input video signal, and converting 
the plurality of video data units into a plurality of video 
data sets, each of the plurality of video data sets includ- 
ing at least two video data units; an operator for 
processing the plurality of video data sets and output- 
ting a plurality of processed video data sets; and a sec- 
ond converter for converting the plurality of processed 
video data sets into a plurality of processed video data 
units corresponding to a plurality of pixels connected to 
one scanning line, and outputting the plurality of proc- 
essed video data units as an output video signal. 
[0063] In one embodiment of the invention, the opera- 
tor includes a plurality of processor elements, and each 
of the plurality of processor elements processes at least 
two image data units included in each of the plurality of 
video data sets. 

[0064] Thus, the invention described herein makes 
possible the advantages of (1) providing a television 
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receiver and a video signal processing device which are 
adaptive to a variety of broadcasting methods without 
increasing the circuit size and the cost, (2) providing 
image processing device/method with a small-size cir- 
cuit configuration which can be used for a variety of 5 
applications, (3) providing image processing 
device/method which effectively utilize resources inside 
the device to perform efficient high-level image process- 
ing, and (4) providing an video signal processing device 
with a reduced cost. 

[0065] These and other advantages of the present 
invention will become apparent to those skilled in the art 
upon reading and understanding the following detailed 
description with reference to the accompanying figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0066] 

Figure 1 is a block diagram illustrating a configura- 20 
tion of a television receiver of Example 1 according 
to the present invention. 

Figure 2 is a block diagram illustrating a configura- 
tion of a television receiver of Example 2 according 25 
to the present invention. 

Figure 3 is a flowchart showing a procedure of a for- 
mat conversion processing and a screen synthesi- 
zation processing performed by an image 30 
processor of the television receiver of Example 2. 

Figure 4 is a flowchart showing another procedure 
of the format conversion processing and the screen 
synthesization processing performed by the image 35 
processor of the television receiver of Example 2. 

Figure 5 is a block diagram illustrating a configura- 
tion of a video signal processing device of Example 

3 according to the present invention. 40 

Figure 6 is a block diagram illustrating a configura- 
tion of a video signal processing device of Example 

4 according to the present invention. 

Figure 7 is a block diagram illustrating an overall cir- 
cuit configuration of an image processor of Exam- 
ple 5 according to the present invention. 

Figure 8 is a blockdiagram illustrating an exemplary 50 
configuration of data buses of the image processor 
of Example 5. 

Figure 9 is a blockdiagram illustrating an exemplary 
circuit configuration of an input section of the image 55 
processor of Example 5. 

Figure 10 is a block diagram illustrating an exem- 



plary configuration of a scan video processor (SVP) 
of the image processor of Example 5. 

Figure 11 is a block diagram illustrating an exem- 
plary configuration of an image memory of the 
image processor of Example 5. 



Figure 14 is a view illustrating an exemplary pointer 
control in the image memory of the image proces- 
sor of Examples. 

Figure 15 is a block diagram illustrating an exem- 
plary configuration of & timing control unit of the 
image processor of Example 5. 

Figure 16 is a blockdiagram illustrating a functional 
configuration of a moving-image real-time process- 
ing system which can be realized by the image 
processor of Example 5. 

Figure 17 is a view illustrating another exemplary 
pointer control in the image memory of the image 
processor of Example 5. 

Figure 18 is a view illustrating an exemplary pixel 
pattern obtained by an image processing method in 
the image processor of Example 5. 

Figure 19 is a timing chart for describing another 
image processing method in the image processor 
of Example 5. 

Figure 20 is a view illustrating an exemplary pixel 
pattern obtained by the method of Figure 19. 



Figure 22 is a timing chart for describing still 
another image processing method in the image 
processor of Example 5. 

Figure 23 is a view illustrating means and function 
for realizing the method of Figure 22. 

Figure 24 is a blockdiagram illustrating a configura- 
tion of a main portion of a television receiver using 
the image processor of Example 5. 



Figures 12A to 12E are views for describing the 
write/read operations of an input buffer of the image 
10 memory of the image processor of Example 5. 

Figures 13A to 13E are views for describing the 
write/read operations of an output buffer of the 
image memory of the image processor of Example 
15 5. 



45 Figure 21 is a block diagram illustrating one exem- 
plary application of the image processor of Exam- 
ple 5. 
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Figure 25 is a block diagram illustrating a configura- 
tion of a main portion of another television receiver 
using the image processor of Example 5. 

Figure 26 is a block diagram illustrating a configura- 
tion of a conventional image processing device. 

Figure 27 is a block diagram illustrating a configura- 
tion of a video signal processor of Example 6 
according to the present invention. 

Figure 28 is a timing chart showing the operations 
of a data input register, an operator, and a data out- 
put register in an LPF processing in Example 6. 

Figures 29A to 29E are timing charts showing the 
operations of a serial-parallel converter and the 
data input register in Example 6. 

Figure 30 is a view diagrammatically illustrating the 
LPF processing performed by the operator in 
Example 6. 

Figures 31 A to 31 E are timing charts showing the 
operations of a parallel-serial converter and the 
data output register in Example 6. 

Figure 32 is a block diagram illustrating a configura- 
tion of a conventional video signal processor. 

Figure 33 is a timing chart showing the operations 
of a data input register, an operator, and a data out- 
put register of the conventional video signal proces- 
sor in the LPF processing. 

Figure 34 is a view diagrammatically illustrating the 
LPF processing performed by the operator of the 
conventional video signal processor. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

[0067] Hereinbelow, the present invention will be 
described by way of example with reference to the 
accompanying drawings. 

(Example 1) 

[0068] Figure 1 illustrates a configuration of a televi- 
sion receiver 1200 of Example 1 according to the 
present invention. 

[0069] The television receiver 1200 of this example 
includes a display device 1050 capable of displaying a 
video signal having a predetermined display format. 
The predetermined display format is, for example, a for- 
mat of 1125 horizontal scanning lines/interlace scan- 
ning. 

[0070] The television receiver 1200 further includes a 



plurality of video signal sources 1210a, 1210b, 1210c, 
1210d which output a plurality of video signals and a 
format conversion section 1100 which converts a video 
format of each of the plurality of video signals into the 

5 display format which is acceptable by the display device 
1050. The "video format" and the "display format" as 
used herein are defined to include the number of hori- 
zontal scanning lines, the aspect ratio, interlace scan- 
ning/non-interlace scanning, and the frequency of 

10 fields. 

[0071] The video signal source 1210a includes a 
V/UHF tuner 1001, a VSB demodulator 1009, a selec- 
tion circuit 1012, and an NTSC decoder 1015. An NTSC 
broadcast signal sent via a ground wave is received by 

15 a V/UHF antenna (not shown). The NTSC broadcast 
signal received by the V/UHF antenna is supplied to the 
VSB demodulator 1009 via the V/UHF tuner 1001. The 
VSB demodulator 1009 converts the NTSC broadcast 
signal into a base-band NTSC signal. The base-band 

20 NTSC signal is then supplied to the NTSC decoder 
1015 via the selection circuit 1012. The NTSC decoder 
1015 decodes the base-band NTSC signal to output a 
RGB signal, which is supplied to the format conversion 
section 1 100. Thus, the RGB signal is supplied from the 

25 video signal source 1 21 0a to the format conversion sec- 
tion 1100. 

[0072] The video signal source 1210b includes a BS 
tuner 1002, an FM demodulator 1010, and a MUSE 
decoder 1016. A high-definition broadcast signal sent 

30 via a broadcasting satellite (BS) is received by a BS 
antenna (not shown). The high-definition broadcast sig- 
nal received by the BS antenna is supplied to the FM 
demodulator 1010 via the BS tuner 1002. The FM 
demodulator 1010 converts the high-definition broad- 

35 cast signal into a base-band MUSE signal. The base- 
band MUSE signal is then supplied to the MUSE 
decoder 1016. The MUSE decoder 1016 decodes the 
base-band MUSE signal to output a high-definition RGB 
signal, which is supplied to the format conversion sec- 

40 tion 1100. Thus, the high-definition RGB signal is sup- 
plied from the video signal source 1210b to the format 
conversion section 1100. 

[0073] The video signal source 1 21 0c includes a com- 
munication satellite (CS) tuner 1003, a QPSKdemodu- 

45 lator 1011, and a digital decoder 1017. A digital 
broadcast signal sent via a communications satellite is 
received by a CS antenna (not shown). The digital 
broadcast signal received by the CS antenna is sup- 
plied to the QPSK demodulator 1011 via the CS tuner 

so 1003. The QPSK demodulator 1011 converts the digital 
broadcast signal into a digital bit stream. The digital bit 
stream is then supplied to the digital decoder 1 01 7. The 
digital decoder 1017 decodes the digital bit stream in 
accordance with an MPEG2 method to output a RGB 

55 signal, which is supplied to the format conversion sec- 
tion 1100. Thus, the RGB signal is supplied from the 
video signal source 1 21 0c to the format conversion sec- 
tion 1100. 
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[0074] The video signal source 1210d includes an 
input terminal 1022. The television receiver 1200 is con- 
nected to a personal computer (PC) 1004 via the input 
terminal 1 022. A RGB signal output from the PC 1 004 is 
supplied to the format conversion section 1100 via the 
input terminal 1022. Thus, the RGB signal is supplied 
from the video signal source 1210d to the format con- 
version section 1100. 

[0075] The RGB signals output from the video signal 
sources 1210a and 1210c, the high-definition RGB sig- 
nal output from the video signal source 1210b, and the 
RGB signal output from the video signal source 1210d 
have different video formats from one another. For 
example, the RGB signals output from the video signal 
sources 1210a and 1210c have a video format of 525 
horizontal scanning lines/interlace scanning. The high- 
definition RGB signal output from the video signal 
source 1210b has a video format of 1125 horizontal 
scanning lines/interlace scanning. The RGB signal out- 
put from the video signal source 121 Od has a video for- 
mat of VGA, SVGA, or the like. 
[0076] The format conversion section 1 1 00 includes a 
selection circuit 1030 which selects one of the plurality 
of video signals output from the plurality of video signal 
sources 1210a to 1210d and an image processor 1 040 
which converts the video format of the video signal 
selected by the selection circuit 1030 into a predeter- 
mined display format capable of being displayed by the 
display device 1050. A general processor may be used 
in place of the image processor 1 040. 
[0077] The selection circuit 1030 selects one of the 
plurality of video signals in accordance with a control 
signal output from a CPU 1020. The video signal 
selected by the selection circuit 1030 is supplied to the 
image processor 1 040. 

[0078] The image processor 1 040 is a programmable 
real-time video signal processing device which per- 
forms a video signal processing in accordance with a 
program. The image processor 1040 reads a program 
corresponding to the format of the video signal selected 
by the selection circuit 1030 from a program memory 
1045 in accordance with the control signal output from 
the CPU 1020, to execute the program. This converts 
the format of the video signal selected by the selection 
circuit 1030 into a predetermined display format which 
can be displayed by the display device 1 050. 
[0079] For example, when the RGB signal output from 
the NTSC decoder 1 01 5 is selected by the selection cir- 
cuit 1030, the image processor 1040 receives a pro- 
gram for converting the video format of "525 horizontal 
scanning lines/interlace scanning" into a display format 
of "1125 horizontal scanning lines/interlace scanning" 
from the program memory 1 045 under the control of the 
CPU 1020. The image processor 1040 executes this 
format conversion program, resulting in providing the 
video signal of which format has been converted into 
the display format capable of being displayed by the dis- 
play device 1 050. The video signal is supplied to the dis- 



play device 1050 for display. 

[0080] When the high-definition RGB signal output 
from the MUSE decoder 1016 is selected by the selec- 
tion circuit 1030, the image processor 1040 receives a 

5 program for allowing the high-definition RGB signal out- 
put from the MUSE decoder 1016 to pass therethrough 
without any processing from the program memory 1045 
under the control of the CPU 1020. This is because the 
video format of the high-definition RGB signal is the 

10 same as the display format capable of being displayed 
by the display device 1050, thereby requiring no format 
conversion. 

[0081] When the RGB signal output from the digital 
decoder 1017 is selected by the selection circuit 1030, 

15 The processing performed by the image processor 
1040 is similar to that performed when the RGB signal 
output from the NTSC decoder 1015 is selected by the 
selection circuit 1030. That is, the video format of "525 
horizontal scanning lines/interlace scanning" is con- 

20 verted into the display format of "1 125 horizontal scan- 
ning lines/interlace scanning". As a result, the video 
signal of which format has been converted into the dis- 
play format capable of being displayed by the display 
device 1 050 is provided as the output of the image proc- 

25 essor 1040. The video signal is supplied to the display 
device 1 050 for display. 

[0082] When the RGB signal input into the input termi- 
nal 1022 is selected by the selection circuit 1030, the 
image processor 1040 receives a program for convert- 

30 ing the video format of the input RGB signal (e.g., VGA, 
SVGA) into the display format of "1 1 25 horizontal scan- 
ning lines/interlace scanning" from the program mem- 
ory 1045 under the control of the CPU 1020. The image 
processor 1040 executes this format conversion pro- 

35 gram, resulting in providing the video signal of which for- 
mat has been converted into the display format capable 
of being displayed by the display device 1050 as the 
output of the image processor 1 040. The video signal is 
supplied to the display device 1050 for display. 

40 [0083] As described above, the CPU 1020 controls 
the selection circuit 1030 and the image processor 
1 040. The control signals output from the CPU 1 020 are 
supplied to the selection circuit 1030 and the image 
processor 1040 via system control buses. The values of 

45 the control signals are determined in accordance with 
user operation information input via a control input ter- 
minal 1021. The user operation information includes a 
channel selection signal. 

[0084] The CPU 1020 also controls the tuning of the 
so V/UHF tuner 1 001 , the BS tuner 1 002, and the CS tuner 
1003. 

[0085] The CPU 1020 further controls the selection 
circuit 1012 which selects the input into the NTSC 
decoder 1015. The selection circuit 1012 is controlled 
55 so as to connect the output of the VSB demodulator 
1009 to the NTSC decoder 1015 when it receives the 
NTSC broadcast signal via a ground wave, or connect 
the output of the FM demodulator 1010 to the NTSC 
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decoder 1 01 5 when it receives the NTSC broadcast sig- 
nal via a BS. 

[0086] Thus, according to the television receiver 1 200, 
video signals having different video formats can be con- 
verted into video signals having a predetermined dis- 
play format by executing format conversion programs 
corresponding to the respective formats of the video 
signals. As a result, one television receiver becomes 
adaptive to a variety of broadcasting methods without 
increasing the circuit size and the cost. 
[0087] In particular, a scan-line video processor (SVP) 
type image processor described in Japanese Laid- 
Open Publication No. 3-258179 can be preferably used 
as the image processor 1040. The SVP type image 
processor is constructed to process a scanning-line 
type signal for each scanning line, which is suitable for 
the format conversion processing such as the conver- 
sion of the number of scanning lines. 
[0088] However, the SVP type image processor is not 
suitable for the synchronous processing in the decoding 
of the NTSC signal. Further, the SVP type image proc- 
essor is not suitable to perform the processing such as 
inverse discrete cosine transformation or perform error 
correction in the decoding of the digital broadcast sig- 
nal. In Example 1 , the decoders 101 5 to 101 7 for decod- 
ing video signals and the format conversion section 
1100 including the image processor 1040 are sepa- 
rately disposed so that only the scanning-line type sig- 
nal can be supplied to the image processor 1040. With 
this configuration, the image processor 1040 is opti- 
mized to obtain a high cost performance. 

(Example 2) 

[0089] Figure 2 illustrates a configuration of a televi- 
sion receiver 1220 of Example 2 according to the 
present invention. The same components as those 
shown in Figure 1 are denoted by the same reference 
numerals, and the descriptions thereof are omitted 
here. 

[0090] A format conversion section 1 1 00 includes: a 
selection circuit 1031 which selects two of a plurality of 
video signals output from a plurality of video signal 
sources 1210a to I2l0d; and an image processor 1041 
which converts the formats of the two video signals 
selected by the selection circuit 1031 into a predeter- 
mined display format capable of being displayed by a 
display device 1050 in accordance with a program, and 
processes the two video signal so that synthesized 
images can be displayed on the display device 1050. 
[0091] The selection circuit 1031 selects two of the 
plurality of video signals in accordance with a control 
signal output from a CPU 1020. The two video signals 
selected by the selection circuit 1 031 are supplied to the 
image processor 1041. The two video signals selected 
by the selection circuit 1031 may be an arbitrary combi- 
nation of two of the plurality of video signals. 
[0092] The image processor 1041 reads programs 



corresponding to the formats of the two video signals 
selected by the selection circuit 1031 from the program 
memory 1 045 in accordance with a control signal output 
from the CPU 1020, to execute the programs. This con- 

5 verts the formats of the two video signals selected by 
the selection circuit 1031 into a predetermined display 
format which can be displayed by the display device 
1050. Moreover, the image processor 1041 synthesizes 
the two video signals selected by the selection circuits 

10 1031 in accordance with a synthesization program, so 
that synthesized images are displayed on the display 
device 1050. 

[0093] Figure 3 shows a procedure of the format con- 
version processing and the screen synthesization 

15 processing performed by the image processor 1 041 . 
[0094] In the procedure shown in Figure 3, it is 
assumed that the RGB signal (A) output from the NTSC 
decoder 1015 and the high-definition RGB signal (B) 
output from the MUSE decoder 1016 have been 

20 selected by the selection circuit 1 031 . Under this situa- 
tion, the image processor 1041 converts the format of 
the RGB signal (A) (525 horizontal scanning lines/inter- 
lace scanning) into a predetermined display format 
(1125 horizontal scanning lines/interlace scanning) 

25 (step S1031). Subsequently, the image processor 1041 
synthesizes a format-converted RGB signal (A') and the 
high-definition RGB signal (B) in accordance with a syn- 
thesization program (step S1032). As a result, a synthe- 
sized video signal (C) having a display format of 1125 

30 horizontal scanning lines/interlace scanning is 
obtained. The format conversion of the high-definition 
RGB signal (B) is not necessary since the signal (B) 
has the same format as the display format. 
[0095] Figure 4 shows another procedure of the for- 

35 mat conversion processing and the screen synthesiza- 
tion processing performed by the image processor 
1041. 

[0096] In the procedure shown in Figure 4, it is 
assumed that the RGB signal (A) output from the NTSC 

40 decoder 1015 and the high-definition RGB signal (B) 
output from the MUSE decoder 1016 are selected by 
the selection circuit 1031. Under this situation, the 
image processor 1041 converts the format of the high- 
definition RGB signal (B) (1125 horizontal scanning 

45 lines/interlace scanning) into the format of the RGB sig- 
nal (A) (525 horizontal scanning lines/interlace scan- 
ning) (step S1041). Subsequently, the image processor 
1041 synthesizes a format-converted high-definition 
RGB signal (B') and the RGB signal (A) in accordance 

so with a synthesization program (step S1 042). As a result, 
a synthesized video signal (C) having a display format 
of 525 horizontal scanning lines/interlace scanning is 
obtained. Thereafter, the image processor 1041 con- 
verts the format of the synthesized video signal (C) (525 

55 horizontal scanning lines/interlace scanning) into a pre- 
determined display format (1125 horizontal scanning 
lines/interlace scanning) (step S1043). As a result, a 
synthesized video signal (D) having a display format of 
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1125 horizontal scanning lines/interlace scanning is 
obtained. 

[0097] The screen synthesization processing is per- 
formed by use of a field memory (not shown). The pro- 
cedure shown in Figure 4 is advantageous over the 
procedure shown in Figure 3 in that the data amount 
stored in the field memory is small. More specifically, in 
the procedure shown in Figure 3, a data amount corre- 
sponding to one field in the format of 1125 horizontal 
scanning lines/interlace scanning must be stored in the 
field memory. On the other hand, in the procedure 
shown in Figure 4, only a data amount corresponding to 
one field in the format of 525 horizontal scanning 
lines/interlace scanning is required to be stored in the 
field memory. In the procedure shown in Figure 4, how- 
ever, the image quality is degraded, compared with the 
procedure shown in Figure 3, because the format of 
1125 horizontal scanning lines/interlace scanning is 
once converted into the format of 525 horizontal scan- 
ning lines/interlace scanning. 
[0098] As described above, the procedures shown in 
Figures 3 and 4 have their merits and demerits. Accord- 
ingly, which procedure should be employed, the proce- 
dure shown in Figure 3 or the procedure shown in 
Figure 4, is determined in consideration of the cost of 
the field memory and the image quality required. 
[0099] Thus, according to the television receiver 1 220 
of this example, video signals having different video for- 
mats can be converted into video signals having a pre- 
determined display format by executing format 
conversion programs corresponding to the respective 
formats of the video signals. As a result, one television 
receiver becomes adaptive to a variety of broadcasting 
methods without increasing the circuit size and the cost. 
Moreover, synthesized images can be displayed on the 
display device 1050 by synthesizing a plurality of video 
signals. 

[0100] Although two video signals are selected from a 
plurality of video signals in this example, the number of 
video signals selected is not limited to two. The present 
invention also allows for selecting more than two video 
signals from a plurality of video signals and performing 
the format conversion processing and the synthesizing 
processing for the more than two video signals 
selected. 

(Example 3) 

[0101] Figure 5 illustrates a configuration of a video 
signal processing device 1300 of Example 3 according 
to the present invention. The video signal processing 
device 1300 includes the format conversion section 
1100 of the television receiver 1200 shown in Figure 1. 
The CPU 1020 and the control input terminal 1021 for 
system control also constitute the video signal process- 
ing device 1300. 

[0102] The video signal proceasing device 1300 
includes a plurality of video signal input terminals 1101, 



1102, 1103, 1104 for receiving a plurality of video sig- 
nals. The plurality of video signals typically have differ- 
ent video formats from one another. For example, the 
RGB signal output from the NTSC decoder 1015 (Fig- 
5 ure 1) is input into the video signal input terminal 1101, 
and the high-definition RGB signal output from the 
MUSE decoder 1016 (Figure 1) is input into the video 
signal input terminal 1102. 

[01 03] The plurality of video signals input via the plu- 
10 rality of video signal input terminals 1101 to 1104 are 
supplied to the format conversion section 1 1 00. 
[0104] The format conversion section 1100 includes 
the selection circuit 1030 and the image processor 
1040. The configurations and operations of the selec- 
15 tion circuit 1030 and the image processor 1040 are as 
described in Example 1. 

[01 05] Video signals of which formats have been con- 
verted by the image processor 1 040 are output from the 
video signal processing device 1300 via a video signal 

20 output terminal 1110. 

[0106] Thus, the video signal processing device 1300 
is adaptive to a variety of broadcasting methods without 
increasing the circuit size and the cost. 
[0107] The video signal processing device 1300 

25 shown in Figure 5 is applicable to a large-screen projec- 
tion type display system. In recent years, an increasing 
number of large-screen projection type display systems 
have been installed in public facilities and the like. Such 
a system is basically constructed in combination of a 

30 projection type display device and a signal reproduction 
device. The video signal processing device 1300 of this 
example may be used as the signal reproduction device. 
In such an application, the video signal processing 
device 1300 converts the formats of video signals input 

35 via the video signal input terminals into a predetermined 
display format, and supplies format-converted video sig- 
nals to the projection type display device. The format 
conversion is performed by executing programs corre- 
sponding to the formats of the video signals. This real- 

40 izes a system which is adaptive to a variety of 
broadcasting methods without increasing the circuit size 
and the cost. Additionally, the resultant system can pro- 
grammably respond to a change in the format of an 
input video signal and a change in the projection type 

45 display device. Thus, the video signal processing circuit 
1300 is highly versatile. 

(Example 4) 

so [0108] Figure 6 illustrates a configuration of a video 
signal processing device 1320 of Example 4 according 
to the present invention. The video signal processing 
device 1320 includes the format conversion section 
1100 of the television receiver 1220 shown in Figure 2. 
55 The CPU 1020 and the control input terminal 1021 for 
system control also constitute the video signal process- 
ing device 1320. 

[0109] The video signal processing device 1320 
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includes a plurality of video signal input terminals 1101 
to 1 1 04 for receiving a plurality of video signals. The plu- 
rality of video signals have different video formats from 
one another. For example, the RGB signal output from 
the NTSC decoder 1015 (Figure 1) is input into the 
video signal input terminal 1101, and the high-definition 
RGB signal output from the MUSE decoder 1016 (Fig- 
ure 1) is input into the video signal input terminal 1102. 
[0110] The plurality of video signals input via the plu- 
rality of video signal input terminals 1101 to 1104 are 
supplied to the format conversion section 1 100. 
[0111] The format conversion section 1100 includes 
the selection circuit 1031, the image processor 1041, 
and the program memory 1045. The configurations and 
operations of the selection circuit 1 031 , the image proc- 
essor 1041, and the program memory 1045 are as 
described in Example 2. 

[01 1 2] Video signals of which formats have been con- 
verted by the image processor 1041 are output from the 
video signal processing device 1320 via a video signal 
output terminal 1110. 

[01 1 3] Thus, the video signal processing device 1 320 
is adaptive to a variety of broadcasting methods without 
increasing the circuit size and the cost. 
[0114] The video signal processing device 1320 
shown in Figure 6 is applicable to a large-screen projec- 
tion type display system for the same reason as that 
described in Example 3. 

[0115] Thus, in Examples 1 and 2 above, the televi- 
sion receiver according to the present invention selects 
one of a plurality of video signals output from a plurality 
of video signal sources. The format of the selected 
video signal is converted into a display format capable 
of being displayed by the display device in accordance 
with a relevant program. Thus, even if the plurality of 
video signals output from the plurality of video signal 
sources have different formats from one another, the 
plurality of video signals can be converted into a prede- 
termined display format by executing programs corre- 
sponding to the respective formats. As a result, a 
television receiver which is adaptive to a variety of 
broadcasting methods without increasing the circuit size 
and the cost is realized. 

[0116] Specifically with respect to Example 2 above, 
the television receiver selects at least two of a plurality 
of video signals output from a plurality of video signal 
sources. The formats of the selected at least two video 
signals are converted into a predetermined display for- 
mat capable of being displayed by the display device in 
accordance with relevant programs. Additionally, the 
selected at least two video signals are processed so 
that synthesized images are displayed on the display 
device. As a result, a television receiver which is adap- 
tive to a variety of broadcasting methods without 
increasing the circuit size and the cost and which also 
displays synthesized images on the screen of the dis- 
play device is realized. 

[0117] In Examples 3 and 4 above, the video signal 



processing device according to the present invention 
selects one of a plurality of video signals input via a plu- 
rality of video signal input terminals. The format of the 
selected video signal is converted into a predetermined 

5 display format in accordance with a relevant program. 
Thus, even if the plurality of video signals input via the 
plurality of video signal input terminals have different 
formats from one another, the plurality of video signals 
can be converted into a predetermined display format 

10 by executing programs corresponding to the respective 
formats. As a result, a video signal processing device 
which is adaptive to a variety of broadcasting methods 
without increasing the circuit size and the cost is real- 
ized. 

15 [0118] Specifically with respect to Example 4 above, 
the video signal processing device selects at least two 
of a plurality of video signals input via a plurality of video 
signal input terminals. The formats of the selected at 
least two video signals are converted into a predeter- 

20 mined display format in accordance with relevant pro- 
grams. Additionally, the selected at least two video 
signals can be synthesized. As a result, a video signal 
processing device which is adaptive to a variety of 
broadcasting methods without increasing the circuit size 

25 and the cost and outputs a synthesized video signal is 
realized. 

(Example 5) 

30 [0119] Figure 7 illustrates a circuit configuration of an 
image processor of Example 5 according to the present 
invention. 

[0120] The image processor of this example includes: 
an input section 2040 which receives a digital video sig- 

35 nal from outside as image data to be processed; a scan- 
line video processor (SVP) 2014 which receives, proc- 
esses, and outputs the image data for each scanning 
line; an image memory 2050 in/from which the image 
data is written/read for each scanning line; on output 

40 section 2070 which outputs processed image data out- 
side; and data buses 2072 which connect the input sec- 
tion 2040, the SVP 2014, the image memory 2050, and 
the output section 2070 with one another. Each of the 
data buses 2072 may, for example, be formed on one 

45 semiconductor chip. 

[0121] The image processor of this example also 
includes: a program memory 2010 made of a RAM 
which holds a program for the SVP 2014; and an 
instruction generation circuit (IG) 2012 which retrieves 

so instructions one by one from the program memory 201 0 
and supplies a control signal such as a microinstruction 
corresponding to the retrieved instruction to the SVP 
2014. These components are provided to enable the 
SVP 2014 to operate as a single-instruction multiple- 

55 data (SIMD) type digital signal processing section. 
[0122] The image processor further includes a timing 
control unit (TCU) 2074 serving as a control means 
which supplies necessary timing control signals to the 
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input section 2040, the SVP 2014, the image memory 
2050, the output section 2070, and the IG 2012. 
[0123] The image processor also includes a ROM 
loader 2076 and on inter IC-bus (l 2 C bus) interface cir- 
cuit 2078, which serve to distribute external program 
data to program data holding portions (memories, regis- 
ters, etc.) disposed sporadically in the components of 
the image processor, i.e., the input section 2040, the 
SIMD type digital signal processing section (the pro- 
gram memory 2010, the IG 2012, and the SVP 2014), 
the image memory 2050, and the output section 2070, 
via an internal bus 2080. A clock circuit (not shown) 
composed of a PLL circuit, for example, for supplying 
necessary clocks to the respective components of the 
image processor is also included. 
[0124] The program data holding portion of the SIMD 
type digital signal processing section is the program 
memory 201 0. The l 2 C bus interface circuit 2078 is con- 
nected to an external controller (not shown) under the 
l 2 C bus standard, so as to receive program data from 
the controller by serial transmission, for example, and 
after converting the received data into parallel data, 
transfer a relevant portion of the converted program 
data to a designated destination (program data holding 
portion). 

[0125] The ROM loader 2076 is connected to an exter- 
nal ROM (not shown). Upon receipt of a desired pro- 
gram number from the external controller via the l 2 C bus 
interface circuit 2078, the ROM loader 2076 reads data 
of a predetermined application program corresponding 
to the program number, and loads the data to the pro- 
gram data holding portions of the respective compo- 
nents. Although the external ROM is required for the 
ROM loader 2076, this data distribution method is 
advantageous in that the program data can be distrib- 
uted in a significantly short time compared with the 
method where the program data is distributed to the 
respective portions by an external controller via the l 2 C 
bus interface circuit 2078. 

[0126] Figure 8 illustrates a concrete example of the 
data bus arrangement of the image processor shown in 
Figure 7. As shown in Figure 8, multiplexers 2082, 
2084, and 2086 are disposed at stages preceding the 
input terminals of the SVP 2014, the image memory 
2050, and the output section 2070, respectively. 
[0127] In the illustrated example, the input section 
2040 is configured to be able to receive up to two sets of 
16-bit digital video signals, for example, simultaneously 
from outside as image data VS to be processed by the 
processor. The SVP 2014 includes input ports for 
receiving up to three digital video signals (image data 
units) simultaneously and output ports for outputting up 
to three image data units simultaneously. The image 
memory 2050 includes three input ports/input buffers 
SDI A , SDI B , and SDI C for receiving up to three image 
data units simultaneously and three output ports/output 
buffers SDO A , SDO B , and SDO c for outputting up to 
three image data units simultaneously. 



[0128] Two-channel output ports of the input section 
2040 are connected to input terminals of the first multi- 
plexer 2082 and also connected to input terminals of the 
second multiplexer 2084. The first and second output 

5 ports of the three-channel output ports of the SVP 2014 
are connected to the input terminals of the second mul- 
tiplexer 2084, while the first and third output ports 
thereof are connected to input terminals of the third mul- 
tiplexer 2086. The first, second, and third output ports of 

w the three-channel output ports of the image memory 
2050 are connected to the input terminals of the first 
multiplexer 2082, while the first and second output ports 
thereof are connected to the input terminals of the third 
multiplexer 2086. 

15 [01 29] The three-channel output terminals of the first 
multiplexer 2082 are connected to the input ports of the 
SVP 2014. The three-channel output terminals of the 
second multiplexer 2084 are connected to the input 
ports of the image memory 2050. The two-channel out- 

20 put terminals of the third multiplexer 2086 are con- 
nected to the input ports of the output section 2070. 
[0130] With the data bus configuration described 
above, the input ports and the outputs ports of the SVP 
2014 and the image memory 2050 are connected with 

25 each other in the crossing relationship via the multiplex- 
ers 2082 and 2084. The switching in each of the multi- 
plexers 2082, 2084, and 2086 is controlled by a timing 
control signal supplied from the TCU 2074 (Figure 7). 
[0131] Figure 9 illustrates an exemplary circuit config- 

30 uration of the input section 2040. In the illustrated exam- 
ple, the input section 2040 includes four input portions 
2040A, 2040B, 2040C, and 2040D corresponding to 
four signals VS 1Y VS 1C , VS 2 y VS 2 c. '■©-. a luminance 
signal (Y) and a color signal (C) for each of the two 

35 series of input video signals. Each input portion 
includes a buffer 2042, a filter 2044, a multiplexer 2046, 
and a setting value register 2048. Each input image 
data unit is first input into the buffer 2042. Then, the 
image data unit is supplied directly to the multiplexer 

40 2046 to be output outside or sent to the filter 2044 to be 
subjected to low-pass filtering for band limit, for exam- 
ple, before being supplied to the multiplexer 2046 to be 
output outside, depending on the switching position of 
the multiplexer 2046. 

45 [0132] The above switching of the multiplexer 2046 
and the filtering of the filter 2044 are controlled by set- 
ting values (i.e., program data PD and a timing control 
signal TC supplied from the TCU 2074) loaded into the 
setting value register 2048 of the relevant input portion 

so from the ROM loader 2076 or the l 2 C bus interface cir- 
cuit 2078 via the internal bus 2080 as described above. 
[0133] Referring back to Figures 7 and 8, the SVP 
2014 includes a three-layer structure composed of a 
data input register (DIR) 2016, a processing portion 

55 2018, and a data output register (DOR) 2020. 

[0134] Figure 10 illustrates an exemplary internal con- 
figuration of the SVP 2014. The DIR 2016 operates in 
accordance with a timing control signal from the TCU 
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2074, a clock from the clock circuit, and an address 
(ADDRESS) from the IG 2012, and receives three 
channels (e.g., 48 bits) of image data units to D N for 
each scanning line repeatedly. 

[0135] The processing portion 2018 is composed of 5 
processing elements PE 1 to PE N (Figure 7) arranged in 
parallel, the number of which is equal to the number N 
of pixels connected to one horizontal scanning line 
(e.g., 864). The processing elements PE-j, PE 2 , PE N 
operate in parallel in accordance with the address 10 
(ADDRESS) and a microinstruction (MICROINSTRUC- 
TION) from the IG 2012 and a clock from the clock cir- 
cuit, and perform the same image processing operation 
for the corresponding pixel data units D 1 , D 2 , D N . 
within one horizontal scanning period. 15 
[0136] The DOR 2020 operates in accordance with a 
control signal from the TCU 2074, a clock from the clock 
circuit, and an address (ADDRESS) from the IG 2012, 
and outputs data units of the operation results from the 
processing elements PE 1 to PE N as three channels at 20 
maximum of image data units D 1 ' to D N ' for each scan- 
ning line. 

[0137] The clocks supplied to the DIR 2016, the 
processing portion 2018, and the DOR 2020 may be 
asynchronous from one another. Each of the data trans- 25 
fer from the DIR 2016 to the processing portion 2018 
and the data transfer from the processing portion 2018 
to the DOR 2020 is performed within one horizontal 
blanking period. 

[0138] Thus, the data input, the parallel operation, and 30 
the data output for pixel data units corresponding to one 
horizontal scanning line are performed by the DIR 2016, 
the processing portion 2018, and the DOR 2020, 
respectively. Each of these processes are performed 
asynchronously and in parallel in a pipeline manner, to 35 
realize real-time image processing. 
[01 39] The operations of the respective portions of the 
SVP 2014 will be briefly described with reference to Fig- 
ure 10. As described above, the operations of the 
respective portions of the SVP 2014 are controlled by 40 
the addresses and microinstructions from the IG 2012, 
the timing control signal from the TCU 2074, the clocks 
from the clock circuits, and the like. 
[0140] Referring to Figure 10, the DIR 2016 has a 
memory capacity capable of storing up to three chan- 45 
nels of the input image data units VS (D i to D N ) for one 
line, and is blocked for each pixel. During the transfer of 
the input image data units D i to D N inside the DIR 2016, 
the image data units D K _ 2 , D K _.|, D K , D K+i , D K+2 , ... are 
received by corresponding register groups of blocks K- 50 
2, K-1, K, K+1, K+2, ... of the DIR 2016 one by one. 
[0141] Each processing element PE K of the process- 
ing portion 2018 includes: a pair of register files RF 0 
and RF-j; a 1-bit arithmetic logic unit (ALU) 2024; a plu- 
rality of (e.g., four) working registers (WRs) (M, A, B, C) 55 
2026; and a left/right (IVR) communication portion 
(LRCOM) 2028 which exchanges data with a plurality of 
left and right adjacent (e.g., four each) processing ele- 



ments (PE K . 4 , PE K . 3l PE K . 2 , PEk.l PE K+1 , PE k+2 , 

PE K+3» PE K+4)- 

[0142] The register file RF 0 is connected to the regis- 
ter groups of the corresponding block of the DIR 2016, 
while the register file RFi is connected to register 
groups of the corresponding block of the DOR 2020. 
One-bit data read from one or both of the register files 
RF 0 and RF 1 is supplied to either of the working regis- 
ters (M, A, B, C) 2026 and also supplied to the eight left 
and right adjacent processing elements (PE K . 4 , PE K _ 3 , 

PE K -2- PE K -1> PE K+ 1> PE K+ 2. PE K+ 3. PE K+ 4) via a mul- 
tiplexer 2030 and a latch circuit 2032 of the L/R commu- 
nication portion 2028. 

[0143] Simultaneously with the above operation, data 
units from the left and right adjacent processing ele- 
ments (PE K -4, PE K -3. PE K -2. PE K -1. PE K+ 1, PE K+ 2- 
PE K+3 , PE K+4 ) are supplied to multiplexers 2034 and 
2036 of the L7R communication portion 2028 of the cur- 
rent processing element PE K . One of these data units is 
selected and input into one of the working registers (M, 

A, B, C) 2026. In Figure 10, one of the data units from 
the left adjacent processing elements (PE K-4 , PE K _ 3 , 
PE K _ 2 , PEk^) is selected and input into the working reg- 
ister (A). 

[0144] The ALU 2024 performs a predetermined oper- 
ation for data supplied from the working registers (M, A, 

B, C) 2026 and outputs the operation results. Data of 
the operation results is written in either one of the regis- 
ter files RF 0 and RF 1b In general, data of the last opera- 
tion result during each horizontal scanning period is 
written in the register file RF on the output side as the 
pixel data unit DK 1 , and transferred from the register file 
RF to the register of the corresponding block of the 
DOR 2020 during the immediately following horizontal 
blanking period. 

[0145] The DOR 2020 has a capacity corresponding 
to the number of channels, the number of bits, and the 
number of pixels of the output image data units D^ to 
D N \ and is blocked for each pixel. The pixel data units 
VS' (Di to D N ') as the operation results are supplied 
from the processing portion 2018 to the blocks of the 
DOR 2020, and output sequentially from the blocks of 
the DOR 2020 during one horizontal scanning period, 
starting from the leftmost pixel data unit D 1 f followed by 
the subsequent pixel data units D 2 \ D 3 \ ... in succes- 
sion. 

[0146] The register files RF 0 and RF 1 of the process- 
ing portion 2018 can accumulate the image data corre- 
sponding to one or two lines. This realizes the function 
of a line memory. The processing portion 2018 can also 
perform individual processing for a plurality of channels 
of image data units within one horizontal scanning 
period in a time-sharing manner. 
[0147] Figure 11 illustrates a specific configuration of 
the image memory 2050 (Figure 7). The illustrated 
image memory 2050 uses a synchronous dynamic ran- 
dom access memory (SDRAM) 2052 as a high-speed 
memory for temporarily storing image data. The 
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SDRAM 2052 has a memory capacity of about 16M 
bits, for example, and includes a mapped memory 
region in a continuous address space. During memory 
accessing, a high-speed clock CK is supplied to the 
SDRAM 2052, in addition to an memory address and 
control signals (RAS, CAS), so that the SDRAM 2052 
can performs data strobing at a timing of the clock CK. 
[0148] The other portions of the image memory 2050 
other than the SDRAM 2052 constitute an interface por- 
tion (SDRAM interface). 

[0149] Each of the input buffers SDI A , SDI B , SDI C and 
the output buffers SDO A , SDO B , SDO c is provided with 
a write (W) pointer register 2054 or 2058 for supplying 
pointing information indicating a write address (position) 
in the buffer and a read (R) pointer register 2056 or 
2060 for supplying pointing information indicating a read 
address (position) in the buffer. The read pointer regis- 
ter 2056 on the input side also has a write address gen- 
eration function for SDRAM accessing. The write 
pointer register 2058 on the output side also has a read 
address generation function for SDRAM accessing. 
[0150] The output terminals of the input buffers SDI A , 
SDI B , and SDI C are connected to a data input terminal 
of the SDRAM 2052. SDRAM addresses generated by 
the read pointer registers 2056 on the input side are 
supplied to an address terminal of the SDRAM 2052 via 
a multiplexer 2062. SRAM addresses generated by the 
write pointer registers 2058 on the output side are sup- 
plied to the address terminal of the SDRAM 2052 via a 
multiplexer 2064 and the multiplexer 2062. 
[0151] A control portion 2066 includes a setting value 
register which receives program data for defining the 
operation mode of the image memory 2050 from the 
ROM loader 2076 or from an external controller via the 
l 2 C interface circuit 2078 and holds the program data 
therein (Figure 7). The control portion 2066, serving as 
a means for controlling the input buffers and the output 
buffers, controls the operations of the buffers and the 
pointer registers on the input and output sides, the 
switching of the multiplexers 2062 and 2064, and the 
memory accessing to the SDRAM 2052 in accordance 
with the program data stored in the setting value regis- 
ter thereof and various timing control signals from the 
TCU 2074. 

[0152] Each of the input buffers SDI A , SDI B , and SDI C 
has a memory capacity corresponding to 128 pixels 
when the image data unit of one pixel is 16 bits, for 
example, and this memory capacity is divided into two 
portions, forming first and second input buffer portions. 
[0153] The write/read operations of the input buffers 
SDI A , SDI B , and SDI C will be described with reference 
to Figures 1 2A to 1 2E. First, data is sequentially written 
in the first (left) input buffer portion starting from a head 
address (Figure 12A). A write pointer P w increments in 
accordance with a clock synchronized with the input 
image data VS (Figure 11). 

[0154] Once the first input buffer portion is filled with 
the input image date, the write pointer P w points to the 



head address of the second (right) input buffer portion 
which is vacant. Upon start of the writing of the input 
image data into the second input buffer portion, a read 
pointer P R points to the head address of the first input 

5 buffer portion, starting the reading of the input image 
data from the first input buffer portion (Figure 12B). 
[0155] The image data read from the input buffer is 
supplied to the data input terminal of the SDRAM 2052. 
The memory address generated by the address gener- 

10 ation function of the read pointer register 2056 is sup- 
plied to the address terminal of the SDRAM 2052 via 
the multiplexer 2062 simultaneously with the supply of 
the image data to the data input terminal of the SDRAM 
2052. At the same time, the address value increments 

15 as the read pointer P R increments. The control portion 
2066 selectively activates the read operations of the 
input buffers SDI A , SDI B , and SDI C by its arbitration 
function. 

[01 56] The read pointer P R is synchronous with a data 
20 write clock for the SD RAM 2052. While the transmission 
rate of normal image data is 10 MHz, the operation 
clock CK for the SDRAM 2052 is several times as high 
as the above rate, e.g., 80 MHz. In the input buffer, 
therefore, the read pointer P R increments several times 
25 as fast as the write pointer P w . Thus, the reading is per- 
formed at a data rate several times as high as the writ- 
ing (Figure 12C). 

[0157] As a result, the reading from the first input 
buffer portion terminates before the completion of the 

30 writing into the second input buffer portion, and the read 
pointer P R stands by at the boundary position (Figure 
12D). Once the writing into the second input buffer por- 
tion is completed (Figure 12E), the read pointer P R 
points to the head address of the second input buffer 

35 portion, starting the reading from the second input 
buffer portion. At this time, the write pointer P w returns 
to the head position of the first input buffer portion which 
is now vacant (in the state where all the image data has 
been read), and starts again the writing into the first 

40 input portion. In this way, the above procedure is 
repeated. 

[01 58] The read pointer P R is only required to read all 
data in the input buffer which is filled with the data. The 
order of the reading is not necessarily the same as that 

45 of the writing by the write pointer P w . Incidentally, in the 
output buffers described hereinafter, the order of the 
writing by the write pointer P w follows the order of the 
reading by the read pointer P R in the input buffer. 
[0159] In the image memory 2050 (Figure 8), each of 

so the output buffers SDO A , SDO B , and SDO c also has a 
memory capacity corresponding to 128 pixels, and the 
memory capacity is divided into two, forming first and 
second output buffer portions. 
[0160] The write/read operations of the output buffers 

55 SDO A , SDO B , SDO c will be described with reference to 
Figures 13A to 13E. The operations of the output buff- 
ers are basically the same as those of the input buffers 
described above. 
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[0161] First, data is sequentially written in the first 
(left) output buffer portion starting from a head address 
(Figure 13A). The data to be written is the image data 
read from the SDRAM 2052 (Figure 11). The write 
pointer P w increments in synchronization with the high- 
speed clock CK for the SDRAM 2052. 
[0162] The memory address generated by the 
address generation function of the write pointer register 
2058 is supplied to the address terminal of the SDRAM 
2052 via the multiplexers 2064 and 2062 in synchroni- 
zation with a read clock of the SDRAM 2052. At the 
same time, the address value increments. 
[0163] The control portion 2066 selectively activates 
the write operation of the output buffers SDO A , SDO B , 
SDO c (Figure 8) by its arbitration function. The control 
portion 2066 also performs the arbitration between the 
write operation of the output buffers SDO A , SDO B , 
SDO c and the read operation of the input buffers SDI A , 
SDI Bl SDI C 

[01 64] Once the first output buffer portion is filled with 
the output image data, the write pointer P w stands by at 
the termination position. Upon start of the reading from 
the output buffer, the read pointer P R points to the head 
address of the first output buffer portion, to perform the 
reading of the output image data from the first output 
buffer portion (Figure 13B). At the same time, the writ- 
ing of the output image data into the second output 
buffer portion is started. The read pointer P R increments 
in synchronization with a clock corresponding to the 
transmission rate of the image data set or selected by 
the control portion 2066, which is however lower than 
the rate of the write pointer P w . 
[0165] Accordingly, the writing into the second output 
buffer portion terminates before the completion of the 
reading from the first output buffer portion, and the write 
pointer P w stands by at the termination position (Fig- 
ures 13C and 13D). 

[0166] Once the reading from the first output buffer 
portion is completed (Figure 13E), the read pointer P R 
points to the head address of the second output buffer 
portion, and starts the reading from the second output 
buffer portion. At this time, the write pointer P w returns 
to the head position of the first output buffer portion, and 
starts again the writing into the first output portion. In 
this way, the above procedure is repeated. 
[0167] Thus, the image memory 2050 of this example 
can receive a plurality of channels of image data via the 
plurality of input ports or input buffers SDI A , SDI B , SDI C 
in parallel synchronously or asynchronously, and output 
a plurality of channels of image data via the plurality of 
output ports or output buffers SDO A , SDO B , SDO c in 
parallel synchronously or asynchronously. 
[0168] In the image memory 2050, a single interface 
portion, in particular, the control portion 2066 efficiently 
controls under a unified management the exchanges of 
the image data between the input buffers SDI A , SDI B , 
SDI C and the common SDRAM 2052 and between the 
SDRAM 2052 and the output buffers SDO A , SDO B , 



SDO c in synchronization with the high-speed clock CK. 
[0169] The image processor of this example can be 
constructed on a single semiconductor chip. Even when 
the SDRAM 2052 is externally mounted, the required 
5 number of terminal pins can be small, realizing a reduc- 
tion of the device size. 

[0170] Since the plurality of input/output ports are pro- 
vided with the plurality of write pointers/read pointers 
and the relationships between the pointers can be pro- 
10 grammably set, a variety of memory functions can be 
realized. 

[0171] For example, as discussed below with respect 
to Figure 14, one channel of image data may be written 
into the SDRAM 2052 via one input buffer, e.g. the input 

15 buffer SDI A , and the image data written into the SDRAM 
2052 may be read via the first and second output buffers 
SDO A and SDO B in parallel by using a time delay of a 
predetermined delay time. With this operation, the 
image data delayed by one field and the image data 

20 delayed by two fields con be obtained simultaneously. 
[0172] Referring to Figure 14, a write address 
(pointer) AW of the SDRAM 2052 corresponds to the 
read pointer P R of the input buffer, and two read 
addresses (pointers) AR a and AR b correspond the write 

25 pointers P w of the output buffers SDO A and SDO B 
[0173] In this example, the SDRAM 2052 is used for 
the image memory 2050. Any other memory which has 
the equivalent memory function may also be used. For 
example, Rambus memories may be used. Alterna- 

30 tively, the image memory 2050 may be composed of a 
plurality of memory chips. 

[0174] Figure 15 illustrates a specific configuration of 
the TCU 2074. The illustrated TCU 2074 includes a 
main control portion MC, a vertical timing generation 

35 portion VTG, and a horizontal timing generation portion 
HTG. The TCU 2074 with the above configuration sup- 
plies timing control signals TC to the respective portions 
of the image processor shown in Figure 7, i.e., the input 
section 2040, the SIMD type digital signal processing 

40 section (2010, 2012, 2014), the image memory 2050, 
the output section 2070, the data buses 2072 (the mul- 
tiplexers 2082, 2084, and 2086), and the like in accord- 
ance with a vertical synchronous signal, a horizontal 
synchronous signal, and a pixel clock extracted from the 

45 video signals (the image data VS) input into the input 
section 2040. 

[0175] The main control portion MC includes a pro- 
gram counter, a program memory, a control logic, and 
the like. The main control portion MC generates a 

so frame-base timing control signal TC MC in accordance 
with the vertical synchronous signal, and controls the 
vertical timing generation portion VTG and the horizon- 
tal timing generation portion HTG of the TCU 2074. The 
vertical timing generation portion VTG includes a 

55 sequence memory VSM and a loop memory VLM, and 
generates a line-base timing control signal TC VT g and 
an internal control signal in accordance with the hori- 
zontal synchronous signal. The horizontal timing gener- 
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ation portion HTG includes a sequence memory HSM 
and a loop memory HLM, and generates a pixel-base 
timing control signal TC H tg in accordance with the pixel 
clock. 

[0176] Various types of program date supplied from 
the ROM loader 2076 or the l 2 C interface circuit 2078 
via the internal bus are stored in various memories such 
as the program memory and the sequence memories in 
the main control portion MC, the vertical timing genera- 
tion portion VTG, and the horizontal timing generation 
portion HTG. 

[0177] The output section 2070 is composed of the 
output buffers, circuits for inserting blanking signals into 
the output image data, and the like. The function of the 
output section 2070 is also controlled by the program 
data supplied from the ROM loader 2076 or the l 2 C 
interface circuit 2078 via the internal bus and the timing 
control signal TC from the TCU 2074. 
[0178] Hereinbelow, the overall operation of the image 
processor with the above configuration will be 
described. 

[0179] Figure 16 is a functional block diagram of an 
exemplary moving-image real-time processing system 
for illustrating the moving-image real-time processing to 
be performed by the image processor of this example. 
[0180] In the illustrated moving-image real-time 
processing system, two field memories 2090 and 2092 
at the input stage constitute one frame memory. A sub- 
tracter 2094 calculates a difference A between the input 
image data VS and image data output from the field 
memory 2092. The difference A is supplied to an abso- 
lute circuit (ABS) 2096 and then to a nonlinearization 
circuit 2098, so as to obtain a signal AS representing the 
degree of the change of the current screen from a 
screen preceding one frame for each pixel. 
[0181 ] The signal AS is then supplied to an averaging 
circuit in the two-dimensional direction composed of a 
line memory 2100 and an adder 2102 and then to an 
averaging circuit in the time-axis direction composed of 
a field memory 2104 and an adder 2108. These two 
averaging circuits constitute a three-dimensional low- 
pass filtering portion, where noise is removed and a 
motion detection signal K (0^1) is obtained. 
[0182] On the other hand, the input image data VS is 
supplied to a moving-image processing portion 2114, 
i.e., an averaging circuit in the vertical direction com- 
posed of a line memory 2110 and an adder 2112, to 
perform a moving-image processing. A mixing circuit 
2124 for motion compensation composed of multipliers 
2116 and 2118, a coefficient converter 2120, and an 
adder 2122 is disposed at the subsequent stage of the 
moving-image processing portion 2114. 
[0183] The motion detection amount is maximum 
when the motion detection signal K is 1 . In such a case, 
the image data from the moving-image processing por- 
tion 2114 is output through the multiplier 2116 and the 
adder 2122 without any processing. At this time, the 
image data delayed by one field supplied from the field 



memory 2090 is blocked at the multiplier 2118. 
[0184] Conversely, the motion detection amount is 
minimum when the motion detection signal K is 0. In 
such a case, the image data from the moving-image 
5 processing portion 2114 is blocked at the multiplier 
2116, and the image data delayed by one field from the 
field memory 2090 is output through the multiplier 2118 
and the adder 2122 as still-image processed image 
data. 

10 [0185] When the motion detection signal K is a value 
between 0 and 1, the image data from the moving- 
image processing portion 2114 and the image data 
delayed by one field from the field memory 2090 are 
mixed with a weighting corresponding to the value, and 

15 averaged image data is output. 

[0186] In order to realize the moving-image real-time 
processing system as described above, the respective 
portions of the image processor perform the following 
processing and operations. 

20 [0187] First, the function of the field memories 2090 
and 2092 at the input stage is realized by the image 
memory 2050 by being controlled as described above 
with reference to Figure 14. More Specifically, the input 
into the field memory 2090 is realized via the first input 

25 buffer SDI A , for example, while the outputs from the field 
memories 2090 and 2092 are realized via the first and 
second output buffers SDO A , and SDO B . 
[0188] The processing by the subtracter 2094, the 
absolute circuit 2096, and the nonlinearization circuit 

30 2098 are performed by the SMID type digital signal 
processing section (2010, 2012, 2014). More specifi- 
cally, the DIR 2016 of the SVP 2014 receives the input 
image data from the input section 2040 (Figure 7) and 
the image data delayed by one frame from the image 

35 memory 2050 (frame memory 2090) simultaneously for 
each line by synchronizing the one-frame delayed 
image data with the input image data from the input sec- 
tion 2040. This synchronization can be realized by 
matching the timing of the reading from the output buffer 

40 SDO of the image memory 2050 with the input image 
data. 

[0189] After the image data corresponding to one line 
has been input into the DIR 2016, the SVP 2014 (Figure 
7) performs all the processing by the portions 2094, 

45 2096, 2098, 2100, 2102, 2108 of the system shown in 
Figure 16 described above during the subsequent hori- 
zontal scanning period, and temporarily outputs data of 
the processing results, i.e., data of the motion detection 
signal K via one output port of the DOR 2020. 

so [0190] The field memory 2104 of the three-dimen- 
sional low-pass filtering portion is realized by the image 
memory 2050. Accordingly, the data of the motion 
detection signal K output from the SVP 2014 as 
described above is written in the SDRAM 2052 via the 

55 third input buffer SDI C of the image memory 2050, read 
after one field from the SDRAM 2052 via the third output 
buffer SDO c , and input into the DIR 2016 of the SVP 
2014. 
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[0191] The processing by the moving-image process- 
ing portion 2114 and the mixing circuit 2124 are also 
performed by the SVP 2014 within the same horizontal 
scanning period as the above-described processing by 
the three-dimensional low-pass filtering portion. More 
specifically, the SVP 2014 receives the image data 
delayed by one field from the first output port of the 
image memory 2050 at the third input port thereof. The 
processed image data VS' is then output from one out- 
put port of the DOR 2020 different from the one men- 
tioned above to the output section 2070. 
[0192] As described above, in the image processor of 
this example, while one channel or a plurality of chan- 
nels of image data or other intermediate data is trans- 
ferred a plurality of times mainly between the SVP 2014 
and the image memory 2050 via the data buses 2072, 
the SVP 2014 performs required processing in accord- 
ance with the program stored in the program memory 
2010. In this way, the image processor can realize the 
moving-image real-time processing system. 
[01 93] The number of field or frame memory functions 
can be increased by increasing the number of input 
ports (input buffers) and output ports (output buffers) of 
the image memory 2050. In this way, in the above- 
described moving-image real-time processing system, 
for example, a noise reduction function may be addition- 
ally provided by subjecting the image data output from 
the mixing circuit 2124 to a low-pass filter composed of 
afield memory. 

[0194] Alternatively, by increasing the input/output 
data rates in the SVP 2014 and the image memory 
2050, a plurality of series or a plurality of channels of 
image data or intermediate data may be input/output via 
a single port in a time-sharing manner within one unit 
period (e.g., one horizontal scanning period). 
[0195] The above-described moving-image real-time 
processing is only an example. The image processor of 
the present invention can realize a variety of image 
processing depending on the programs installed therein 
from outside. Some of such processing will be 
described hereinbelow. 

[0196] Figure 17 illustrates a pointing control of the 
image memory 2050 (Figure 8) for displaying different 
series or channels of images simultaneously by dividing 
the screen into two. In the illustrated example, the first 
channel of image data is compressed to be written into 
the left half of each line in the SDRAM 2052 using a first 
write pointer AW a . At the same time, the second chan- 
nel of image data is compressed to be written into the 
right half of each line using a second write pointer AW b . 
These two channels of image data may be written asyn- 
chronously, but the head write positions of the fields 
should be matched with one another. 
[0197] The image data written in the SDRAM 2052 in 
the above-described manner is read for each line after a 
delay of a predetermined time using a first read pointer 
AR a , for example. The read image data is sent to a dis- 
play device for screen display. As a result, an image cor- 



responding to the first channel is displayed on the left 
half of the screen, while an image corresponding to the 
second channel is displayed on the right half of the 
screen. A large and small window display can also be 

5 realized in a similar manner. 

[0198] As shown in Figure 17, in parallel with the dou- 
ble-screen display processing as described above, an 
arbitrary memory function, e.g., a field or frame memory 
function may be provided by utilizing remained ports 

10 and memory regions of the image memory 2050 and 
using another pair of write/read pointers (AW C and 
AR C ). 

[0199] When one set or a plurality of sets of pointing 
operations are to be performed in the image memory 

15 2050 as described above, a predetermined amount of 
memory portion is allocated to each set, so that each 
pointer may be turned in a loop within the memory por- 
tion. This enables to form many independent memory 
portions in the memory region of the SDRAM 2052. 

20 [0200] As another application, in the writing of image 
data into the image memory 2050, the image data cor- 
responding to only a portion of pixels or scanning lines 
may be selectively written. This reduces the number of 
pixels and the number of scanning lines for each image. 

25 In this way, a contracted screen as shown in Figure 18 
can be produced. In this case, however, the rate of 
image data when it is read from the image memory 
2050 must be made equal to that when it is written into 
the image memory 2050. 

30 [0201] In the above decimation processing, in consid- 
eration of the reproducibility of the pattern of an image, 
the image data is preferably first supplied to the SVP 
2014 (Figure 8) first to be subjected to a low-pass filter- 
ing, and then written into the image memory 2050 in the 

35 above-described manner. 

[0202] Alternatively, as shown in Figure 19, in the 
reading of image data from the image memory 2050, 
the image data may be read intermittently with respect 
to a read clock CL for pixels or scanning lines. This ena- 

40 bles to expand the space between pixels or scanning 
lines as shown in Figure 20. In this case, the image data 
read from the image memory 2050 may be input into the 
SVP 2014 to perform horizontal and vertical interpola- 
tions, so that image data may be added or inserted to 

45 the positions of the pixels or scanning lines which had 
been skipped in the above intermittent reading, as 
shown by the dotted lines in Figure 20. 
[0203] As shown in Figure 21 , two series of asynchro- 
nous image data units VS-j and VS 2 may be input into 

so the SVP 2014 and the image memory 2050, respec- 
tively, and the image data units VS i and VS 2 may be 
read in synchronization with a synchronous signal other 
than synchronous signals for the image data units VSi 
and VS 2 , for example, a synchronous signal on the side 

55 of a display device 2130. At this time, the image data 
units VS 1 and VS 2 may be read as image data for a dou- 
ble-screen synthesized display as shown in Figure 17. 
[0204] In the image processor in this example, when 
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the number n of pixels per line of the input image data 
VS is remarkably larger than the number of pixels per 
line which can be processed at one time by the SVP 
2014, i.e., when n = 1600 the number N of processing 
elements PE = 864, a method as shown in Figures 22 5 
and 23 may be employed. 

[0205] Conceptually, as shown in Figure 22, the input 
image data VS is divided into two portions, a former half 
VSj and a latter half VSj, with a time gap td of an appro- 
priate amount (e.g., a gap corresponding to 100 pixels) 
interposed therebetween. The image data unit of each 
of the former half VSj and the latter half VSj is then 
sequentially input into the DIR 2016 (Figure 7) of the 
SVP 2014 as a pixel data unit having n/2 (800) pixels 
per line. 

[0206] The processing portion 2018 of the SVP 2014 
allocates separate processing periods for the image 
data units of the former half VSj and the latter half VSj, 
and performs the same processing repeatedly. The 
DOR 2020 outputs the processed image data unit in 
series. 

[0207] In the output operation, the image data unit of 
the former half VSj is delayed by a time corresponding 
to the above time gap, while the image data unit of the 
latter half VSj is output without any delay from the same 
port of the output section 2070. As a result, the head of 
the image data unit of the latter half VSj comes in con- 
tact with the tail of the image data unit of the former half 
VSj, so that the processed image data having n (1600) 
pixels per line which is the same as the original input 
image data VS is obtained. 

[0208] As described above, one line may be divided 
into two for high-precision image data having a remark- 
ably large number n of pixels per line. 
[0209] In the above series of processing, the process 
of dividing the input image data VS into the former half 
VSj and the latter half VSj and forming the time gap td 
therebetween is performed by using the image memory 
2050 and the multiplexer 2082 as a delay line as shown 
in Figure 23. 

[021 0] More specifically, the input image data VS from 
the input section 2040 is directly sent to a first input ter- 
minal of the multiplexer 2082 (Figure 8), and is simulta- 
neously input into the image memory 2050. Delayed 
image data VS D delayed by a time corresponding to the 
fixed time gap td behind the input image data VS is out- 
put from one output port of the image memory 2050, to 
be sent to a second input terminal of the multiplexer 
2082. 

[021 1 ] The multiplexer 2082 switches to the first input 
terminal for a predetermined time starting from the tim- 
ing at the head of the input image data VS in accord- 
ance with a timing control TC M from the TCU 2074 
(Figure 7). Then, after a predetermined shut-off time, 
the multiplexer 2082 switches to the second input termi- 
nal. As a result, the input image data VS is divided into 
the former half VSj and the latter half VSj with the time 
gap td of a predetermined among therebetween, and 



supplied to the SVP 2014. 

[0212] By providing the time gap td of an appropriate 
amount between the former half VSj and the latter half 
VSj, the tail portion of the former half VSj and the head 
portion of the latter half VSj are prevented from interfer- 
ing or colliding against each other. Thus, data is pre- 
vented from being lost. 

[021 3] As shown in Figure 23, while securing the time 
gap td of an appropriate amount, preferably, a portion 5 
which overlaps the head portion of the latter half VSj by 
a predetermined number of pixels (e.g., 10 pixels) may 
be added to the tail of the former half VSj, and a portion 
5 which overlaps the tail portion of the former half VSj by 
a predetermined number of pixels (e.g., 10 pixels) is 
added to the head of the latter half VSj. These overlap 
portions are also input into the SVP 2014, so that the 
processing portion 2018 of the SVP 2014 can perform a 
high-precision processing for the tail portion of the 
former half VS S and the head portion of the latter half 
VSj as is performed for the intermediate portions. 
[0214] The processing of making the head of the latter 
half VSj in contact with the tail of the former half VSj as 
the last output processing is performed by using the 
image memory 2050 and the multiplexer 2086 as the 
delay line in a configuration similar to that shown in Fig- 
ure 23. 

[021 5] The image processor of this example can real- 
ize image compression of the image data using the dec- 
imation function of the SVP 2014 or the image memory 
2050 as described above. At this information compres- 
sion, the input image data is first subjected to the low- 
pass filtering in the input section 2040 before being sup- 
plied to the SVP 2014 or the image memory 2050, so as 
to avoid a degradation in image quality such as a folding 
distortion caused by the information compression. 
[0216] Figure 24 illustrates an exemplary circuit con- 
figuration of a main portion of a television receiver which 
uses the image processor of this example. 
[0217] The television receiver with the image proces- 
sor of this example incorporated therein is adaptive to a 
variety of video signals such as a monitor output signal 
PC from a personal computer, a base-band signal BB 
from a VTR and the like, a high-definition signal MUSE, 
and an NTSC signal NTSC. For example, a variety of 
modes may be set, including a mode where the NTSC 
signal is displayed on a monitor after passing through a 
D/A converter and simultaneously another arbitrary 
video signal is output via a D/A converter and recorded 
to a VTR or the like, and a mode where the high-defini- 
tion signal and the NTSC signal are synthesized to dis- 
play both signals on a monitor. When one of these 
modes is selected, corresponding program data may be 
loaded in the respective sections of the image proces- 
sor by a download method as described above. 
[0218] Figure 25 illustrates an exemplary circuit con- 
figuration of another television receiver which uses the 
image processor of this sample. 
[021 9] The television receiver includes a US standard 
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advanced TV (ATV) decoder incorporated therein. This 
ATV decoder can decode input video signal transmitted 
under any of 18 types of display formats (e.g., 480 lines 
x 640 pixels, 600 lines x 800 pixels, and 768 lines x 
1024 pixels). 

[0220] However, although a reproduced video signal 
having any of the 18 types of display formats is output 
from the ATV decoder, a display device incorporated in 
the television receiver (e.g., a CRT, an LCD, and a 
plasma display) is only allowed to display the image 
data under one type of format (e.g., 768 lines x 1024 
pixels). 

[0221] The image processor of this example converts 
the reproduced video signal from the ATV decoder into 
a display format used by the display device before sup- 
plying the signal to the display device. 
[0222] Thus, as described above, according to the 
image processing device of the present invention, the 
SIMD type digital signal processing section and the 
image memory which can perform the write operation 
and the read operation in parallel and independently are 
connected with each other via the data buses, so that 
the respective sections of the device can be program- 
mably operated. Accordingly, the device can be adap- 
tive to a variety of applications with a reduced-size 
circuit configuration. Further, the resources inside the 
device can be effectively utilized, to realize an effective 
high-level image processing. 

(Example 6) 

[0223] Figure 27 illustrates a configuration of a video 
signal processor 3001 of Example 6 according to the 
present invention. The video signal processor 3001 
includes a serial-parallel converter 3016, a data input 
register 3011, an operator 3012, a data output register 
3015, and a parallel-serial converter 3017. 
[0224] The serial-parallel converter 3016 receives a 
plurality of video data units corresponding to a plurality 
of effective pixels connected to one horizontal scanning 
line sent in series as an input video signal S3001. The 
serial-parallel converter 3016 converts the plurality of 
video data units into a plurality of video data sets. For 
example, the serial-parallel converter 3016 generates 
the video data sets by coupling the current video data 
unit among the plurality of video data units with a video 
data unit which has been delayed by a flipflop (FF) by 
one cycle of a video clock. In this case, when the bit 
width of the video data unit is eight bits, the bit width of 
the video data set is 16 (= 8x2) bits. The current video 
data and the video data delayed by one cycle of the 
video clock constituting the video data set are input into 
the data input register 301 1 in parallel, and a plurality of 
such video data sets are input into the data input regis- 
ter 301 1 in series as a video signal S3003. 
[0225] The data input register 301 1 outputs the plural- 
ity of serially input video data sets in parallel. The data 
input register 3011 has a width of s bits and a depth of 



N words. The bit width s of the data input register 3011 
needs to be n times or more as large as the bit width of 
the video data unit wherein n is an integer equal to or 
more than 2 representing the number of video data units 

5 included in the video data set. The value n also repre- 
sents the degree of parallelism when a plurality of video 
data units are arranged in parallel. 
[0226] The operator 3012 performs predetermined 
operations on the plurality of video data sets output from 

10 the data input register 3011 in parallel. The operator 
3012 includes N processor elements PE 1 to PE N . Each 
of the processor elements PE 1 to PE N includes a small- 
capacity memory 3013 which holds the input data and 
an operation result and an operating element 3014 

15 which performs a predetermined signal processing 
operation. 

[0227] The data output register 301 5 outputs the plu- 
rality of video data sets processed by the operator 301 2 
in series. The data output register 3015 has a width of t 

20 bits and a depth of N words. The bit width t of the data 
output register 3015 needs to be n times or more as 
large as the bit width of the video data unit wherein n is 
an integer equal to or more than 2 representing the 
number of video data units included in the video data 

25 set. 

[0228] The parallel-serial converter 301 7 receives the 
plurality of video data sets output in series from the data 
output register 3015 as a video signal S3004, and con- 
verts the plurality of video data sets into a plurality of 

30 video data units. For example, the parallel-serial con- 
verter 301 7 converts the plurality of video data sets into 
a plurality of video data units by alternately selecting the 
current video data units and the video data units 
delayed by one cycle of the video clock included in the 

35 plurality of video data sets. The plurality of video data 
units are output in series as an output video signal 
S3002. 

[0229] Hereinbelow, the operation of the video signal 
processor 3001 will be described, taking the LPF (low- 
40 pass filtering) processing as an example. 

[0230] Figure 28 is a timing chart illustrating the oper- 
ations of the data input register 3011, the operator 
3012, and the data output register 3015 in the LPF 
processing. 

45 [0231] The video signal processor 3001 operates in 
accordance with a horizontal synchronous signal, which 
defines a horizontal blanking period and an effective 
video period as shown in Figure 28. 
[0232] During an effective video period Pj, a plurality 

so of video data sets corresponding to one horizontal scan- 
ning line are input into the data input register 3011 in 
series. For example, one horizontal scanning line may 
be the i-th horizontal scanning line. Hereinbelow, the i-th 
horizontal scanning line is referred to as the i line 

55 wherein i is an arbitrary integer. 

[0233] During a horizontal blanking period Bj following 
the effective video period Pj, the plurality of video data 
sets corresponding to the i line input into the data input 
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register 3011 are transferred to the operator 3012 in 
parallel. 

[0234] During an effective video period P i+1 following 
the horizontal blanking period Bj, the LPF processing is 
performed for the plurality of video data sets corre- 
sponding to thei line. 

[0235] During a horizontal blanking period B j+1 follow- 
ing the effective video period P j+1 , a plurality of Un- 
processed video data sets corresponding to the i line 
are transferred to the data output register 301 5 in paral- 
lel. 

[0236] During an effective video period P i+2 following 
the horizontal blanking period B i+i (not shown in Figure 
28), the plurality of LPF-processed video data sets cor- 
responding to the i line are output from the data output 
register 3015 in series. 

[0237] The above-described processing are also per- 
formed for a plurality of video data sets corresponding 
to an (i-1) line and a plurality of video data units corre- 
sponding to an (i+1) line. 

[0238] Figures 29A to 29E illustrate the operations of 
the serial-parallel converter 3016 and the data input 
register 3011. 

[0239] The serial-parallel converter 3016 operates in 
accordance with the video clock of which waveform is 
shown in Figure 29A. 

[0240] The serial-parallel converter 3016 receives a 
plurality of video data units Dj (j is an integer equal to or 
more than 0) corresponding to a plurality of effective pix- 
els connected to one horizontal scanning line input in 
series as the input video signal S3001 . The waveform of 
the input video signal S3001 is shown in Figure 29B. 
[0241] The serial-parallel converter 3016 couples a 
current video data unit D 2 j+i with a video data unit D 2 j 
which has been delayed by a flipflop (FF) by one cycle 
of the video clock, so as to generate a video data set 
(D 2 j, D 2 j+i). For example, when the bit width of the video 
data unit D 2 j +1 is eight bits, the bit width of the video 
data set (D 2 j, D 2 j +1 ) is 16 (= 8x2) bits. The current video 
data unit D 2 j +1 and the video data D 2 j delayed by one 
cycle of the video clock are input into the data input reg- 
ister 301 1 in parallel, and the plurality of video data sets 
(D 2 j, D 2j+1 ) are input into the data input register 301 1 in 
series as the video signal S3003. The waveform of the 
video signal S3003 is shown in Figure 29C. 
[0242] The data input register 3011 controls the writ- 
ing of the video signal S3003 into the data input register 
3011 in accordance with a write enable signal WE. In 
other words, the data input register 3011 permits the 
video signal S3003 to be written thereinto when the 
write enable signal WE is in a high level, and prohibits 
the video signal S3003 to be written thereinto when the 
write enable signal WE is in a low level. The waveform 
of the write enable signal WE is shown in Figure 29D. 
[0243] By using the write enable signal WE having the 
waveform shown in Figure 29D, the video signal S3003 
is written into the data input register 301 1 for each cycle 
of the write enable signal WE. In this way, the video data 



D 2j and the video data unit D 2 j +1 included in the video 
data set (D 2 j, D 2 j +1 ) are input into the data input register 
3011 in parallel. 

[0244] Figure 30 diagrammatically illustrates the LPF 
5 processing performed by the operator 3012. In the 
example shown in Figure 30, the operator 3012 per- 
forms the LPF processing for the video date units D 2 j_2, 
D 2j-1> D 2jj D 2j+i5 D 2j+2> D 2j+3 corresponding to the i line, 
and outputs the LPF-processed video data units D'^, 
10 D' 2 j_i, D' 2 j, D' 2 j + i, D' 2J+2 , D' 2 j +3 corresponding to the i 
line. 

[0245] The LPF-processed video data D' 2 j is obtained 
by the calculation of expression (2) below, and the LPF- 
processed video data D' 2 j +1 is obtained by the calcula- 
15 tion of expression (3) below. 

D' 2j = 1/4 • D 2 j_i + 1/2 • D 2j + 1/4 • D 2j+1 (2) 

D' 2j+1 =1/4.D 2j + 1/2.D 2j+1+ 1/4.D 2j+2 (3) 

20 

[0246] The calculations of expressions (2) and (3) are 
performed by the processor element PEj. Similar calcu- 
lations to those of expressions (2) and (3) are per- 
formed by each of the processor elements PE^ and 

25 PEj +1 . The number of LPF processing performed by 
each of the processor elements PE^, PEj, and PE j+i is 
two for one line. In this way, the LPF-processed video 
data units D' 2 j_ 2 , D' 2 j.i, D' 2 j, D' 2 j+i 5 D' 2 j + 2. D' 2 j +3 corre- 
sponding to the i line are obtained. 

30 [0247] When the number of video data units included 
in the video data set is n, the number of LPF processing 
performed by each processor element is n. 
[0248] Figures 31 A to 31 E illustrates the operations of 
the parallel-serial converter 3017 and the data output 

35 register 3015. 

[0249] The parallel-serial converter 3017 operates in 
accordance with a video clock of which waveform is 
shown in Figure 31 A. 

[0250] The data output register 3015 controls the 

40 reading of the LPF-processed video data set (D' 2 j, 
D* 2 j+i) stored in the data output register 3015 in accord- 
ance with a read enable signal RE. In other words, the 
data output register 3015 permits the LPF-processed 
video data set (D' 2 j, D' 2j+1 ) to be read therefrom when 

45 the read enable signal RE is in a high level, and prohib- 
its the LPF-processed video data set (D' 2 j, D' 2 j +1 ) to be 
read therefrom when the read enable signal RE is in a 
low level. The waveform of the read enable signal RE is 
shown in Figure 31 B. 

so [0251] The parallel-serial converter 3017 receives the 
plurality of LPF-processed video data sets (D' 2 j, D' 2 j +1 ) 
input in series as the video signal S3004. The waveform 
of the video signal S3004 is shown in Figure 31 C. 
[0252] The parallel-serial converter 3017 delays the 

55 LPF-processed video data D' 2 j+i among the LPF-proc- 
essed video data sets (D' 2j , D' 2j+1 ) input as the video 
signal S3004 by one cycle of the video clock, so as to 
generate an internal video signal S3005. The waveform 



21 



41 



EP 0 905 973 A2 



42 



of the internal video signal S3005 is shown in Figure 
31 D. The LPF-processed video data D' 2 j+i can be 
delayed by the flipflop (FF) P for example. 
[0253] The parallel-serial converter 3017 outputs a 
plurality of LPF-processed video data units D j Q is an 5 
integer equal to or more than 0) in series as the output 
video signal S3002 by alternately selecting the most 
significant bit portion and the least significant bit portion 
of the internal video signal S3005 for each cycle of the 
video clock. The waveform of the output video signal 10 
S3002 is shown in Figure 31 E. The selection of the 
internal video signal S3005 is realized by a selector, for 
example. 

[0254] Thus, in this example, a plurality of video data 
units corresponding to a plurality of effective pixels con- 15 
nected to one horizontal line are converted into a plural- 
ity of video data sets by the serial-parallel converter 
3016. At least two video data units included in each 
video data set are processed by each processor ele- 
ment PEj, and the plurality of video data sets are con- 20 
verted into the plurality of video data units 
corresponding to the plurality of effective pixels con- 
nected to one horizontal scanning line by the parallel- 
serial converter 3017. In this way, the video data units 
corresponding to one horizontal scanning line can be 25 
processed using the number of processor elements PEj 
smaller than the number of effective pixels connected to 
one horizontal scanning line. For example, when each 
video data set includes n video data units, the number 
of processor elements PEj can be l/n of the number of 30 
effective pixels connected to one horizontal scanning 
line. 

[0255] The processing performed by the operator 
3012 is not restricted to the LPF processing. The LPF 
processing is merely an example of the processing 35 
which can be performed by the operator 3012. The 
operator 3012 may perform an arbitrary processing 
other than the LPF processing, such as other filtering 
processing and image processing. 
[0256] In this example, the degree of parallelism 40 
where a plurality of video data units are arranged in par- 
allel for the serial-parallel converter 3016 and the paral- 
lel-serial converter 3017 is set at 2. The degree of 
parallelism is not restricted to 2, but can be an arbitrary 
integer equal to or more than 3 as well. 45 
[0257] In the video signal processor according to the 
present invention, a plurality of video data units corre- 
sponding to a plurality of effective pixels connected to 
one scanning line are converted into a plurality of video 
data sets. Each of the plurality of video data sets 50 
includes at least two video data units. The plurality of 
video data sets are processed, and the plurality of proc- 
essed video data sets are converted into the plurality of 
processed video data units. In this way, since the 
processing is performed for the video data set including 55 
at least two video data units as a unit, the processing 
efficiency is improved. 

[0258] Each of the plurality of processor elements of 



the operator processes at least two video data units 
included in one video data set. Accordingly, the number 
of processor elements of the operator can be made 
smaller than the number of effective pixels connected to 
one scanning line. For example, when each video data 
set includes n video data units, the number of processor 
elements of the operator can be l/n of the number of 
effective pixels connected to one scanning line. By 
reducing the number of processor elements required to 
process one scanning line, the cost of the entire video 
signal processor can be reduced. 
[0259] It will be appreciated that the video signal proc- 
essor of this example may also be used in conjunction 
with the television receivers discussed above with 
respect to Figures 24 and 25. 
[0260] Various other modifications will be apparent to 
and can be readily made by those skilled in the art with- 
out departing from the scope and spirit of this invention. 
Accordingly, it is not intended that the scope of the 
claims appended hereto be limited to the description as 
set forth herein, but rather that the claims be broadly 
construed. 

Claims 

1. A television receiver including a display device 
capable of displaying a video signal having a prede- 
termined display format, the television receiver 
comprising: 

a plurality of video signal sources; 
a selection circuit for selecting one of a plurality 
of video signals output from the plurality of 
video signal sources; and 
an image processor for converting a format of 
the video signal selected by the selection cir- 
cuit into the predetermined display format, 
wherein a video signal output from the proces- 
sor is supplied to the display device. 

2. A television receiver according to claim 1, wherein 
each of the plurality of video signal sources 
includes at least one of an NTSC decoder, a MUSE 
decoder, and a digital decoder. 

3. A television receiver including a display device 
capable of displaying a video signal having a prede- 
termined display format, the television receiver 
comprising: 

a plurality of video signal sources; 
a selection circuit for selecting at least two of a 
plurality of video signals output from the plural- 
ity of video signal sources; and 
an image processor for converting a format of 
each of the at least two video signals selected 
by the selection circuit into a predetermined 
display format, and processing the at least two 
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video signals so that synthesized images are 
displayed on the display device, 
wherein a video signal output from the proces- 
sor is supplied to the display device. 

4. A television receiver according to claim 3, wherein 
each of the plurality of video signal sources 
includes at least one of an NTSC decoder, a MUSE 
decoder, and a digital decoder. 

5. A video signal processing apparatus comprising: 

a plurality of video signal input terminals for 
receiving a plurality of video signals; 
a selection circuit for selecting one of the plu- 
rality of video signals input via the plurality of 
video signal input terminals; and 
an image processor for converting a format of 
the video signal selected by the selection cir- 
cuit into a predetermined display format. 



control means for controlling the input section, 
the digital signal processing section, the image 
memory, and the output section in accordance 
with program data. 

5 

8. An image processing device according to claim 7, 
wherein the digital signal processing section 
includes: a data input portion for receiving in paral- 
lel for each scanning line at least one image data 

10 unit corresponding to at least one respective video 
signal; and a data output portion for outputting in 
parallel for each scanning line the at least one 
image data unit processed for each scanning line 
by the plurality of processing elements, 

15 wherein a data input operation for each 

scanning line by the data input portion, a process- 
ing operation for each scanning line by the plurality 
of processing elements, and a data output opera- 
tion for each scanning line by the date output sec- 

20 tion are performed in a pipeline manner. 



6. A video signal processing apparatus comprising: 

a plurality of video signal input terminals for 
receiving a plurality of video signals; 
a selection circuit for selecting at least two of 
the plurality of video signals input via the plural- 
ity of video signal input terminals; and 
an image processor for converting a format of 
each of the at least two video signals selected 
by the selection circuit into a predetermined 
display format, and synthesizing the at least 
two video signals. 

7. An image processing device comprising: 

an input section for receiving image data to be 
processed; 

a digital signal processing section including a 
plurality of processing elements allocated to 
respective pixels corresponding to one scan- 
ning line in a one-to-one relationship for per- 
forming a same operation in accordance with a 
common instruction, the digital signal process- 
ing section receiving, processing, and output- 
ting the image data for each scanning line; 
an image memory having a fixed memory 
region and capable of performing a write oper- 
ation and a read operation in parallel and inde- 
pendently, the image memory receiving and 
outputting the image data for each scanning 
line; 

an output section for outputting processed 
image data; 

data bus means for connecting the input sec- 
tion, the digital signal processing section, the 
image memory, and the output section with one 
another; and 



9. An image processing device according to claim 7, 
wherein the image memory includes: data write 
means for sequentially writing the input image data 

25 into the memory region in sequential addresses; 
data read means for reading the image data to be 
output from the memory region in sequential 
addresses; and pointer control means for control- 
ling a write pointer and a read pointer for indicating 

30 a write address and a read address in the memory 
region, respectively, in accordance with the pro- 
gram data. 

10. An image processing device according to claim 9, 
35 wherein the image memory further includes: a plu- 
rality of input buffers each having at least first and 
second input buffer portions with a respective pre- 
determined memory capacity; and 

40 means for controlling the plurality of input buff- 

ers such that when the first input buffer portion 
of the input buffer is filled with image data, writ- 
ing of input image data into the second input 
buffer portion is started, and image data is read 

45 from the first input buffer portion to be written 

into the memory region, and 
when the second input buffer portion is filled 
with image data, writing of input image data 
into the first input buffer portion is started, and 

so image data is read from the second input buffer 

portion to be written into the memory region. 

11. An image processing device according to claim 10, 
wherein a data rate at which image data is written 

55 into the memory region from the input buffer is 
selected to be different from a data rate at which 
image data is written into the input buffer. 



23 



45 



EP 0 905 973 A2 



46 



12. An image processing device according to claim 9, 
wherein the image memory further includes: a plu- 
rality of output buffers each having at least first and 
second output buffer portions with a respective pre- 
determined memory capacity; and 

means for controlling the plurality of output 
buffers such that when the first output buffer 
portion of the output buffer has no image data, 
reading of image data from the second output 
buffer portion is started, and image data read 
from the memory region is written into the first 
output buffer portion, and 
when the second output buffer portion has no 
image data, reading of image data from the first 
output buffer portion is started, and image data 
read from the memory region is written into the 
second output buffer portion. 

13. An image processing device according to claim 12, 
wherein a data rate at which image data is written 
into the output buffer from the memory region is 
selected to be different from a data rate at which 
image data is read from the output buffer. 

14. An image processing device according to claim 7, 
wherein the data bus means includes: a first data 
bus portion for electrically connecting a data output 
terminal of the input section with a data input termi- 
nal of the digital signal processing section; a sec- 
ond data bus portion for electrically connecting a 
data output terminal of the input section with a data 
input terminal of the image memory; a third data 
bus portion for electrically connecting a data output 
terminal of the digital signal processing section with 
a data input terminal of the image memory; a fourth 
data bus portion for electrically connecting a data 
output terminal of the image memory with a data 
input terminal of the digital signal processing sec- 
tion; a fifth data bus portion for electrically connect- 
ing a data output terminal of the input section with a 
data input terminal of the output section; a sixth 
data bus portion for electrically connecting a date 
output terminal of the digital signal processing sec- 
tion with a data input terminal of the output section; 
and a seventh data bus portion for electrically con- 
necting a data output terminal of the image memory 
with a data input terminal of the output section. 

15. An image processing device according to claim 14, 
wherein all of the first to seventh data bus portions 
are formed on a semiconductor chip. 

16. An image processing device according to claim 7, 
wherein the control means includes: program data 
holding means for holding program data defining 
operation modes for the input section, the digital 
signal processing section, the image memory, the 



output section, and the data bus means; and pro- 
gram data distribution means for receiving program 
data and distributing the program data into the pro- 
gram data holding means. 

5 

17. An image processing method for processing image 
data by the image processing device according to 
claim 7, the method comprising the steps of: 

10 receiving image data corresponding to one 

video signal by the input section; 
performing a first processing for the image data 
output from the input section to the digital sig- 
nal processing section by the digital signal 
15 processing section; 

writing the image data output from the digital 
signal processing section after the first 
processing into the image memory to tempo- 
rarily store the image data in the image mem- 
20 ory; and 

receiving the image data read from the image 
memory by the digital signal processing section 
again to perform a second processing. 

25 18. An image processing method according to claim 

17, further comprising the steps of: 

writing the image data output from the digital 
signal processing section after the second 
30 processing into the image memory to tempo- 

rarily store the image data in the image mem- 
ory; and 

receiving the image data read from the image 
memory by the digital signal processing section 
35 again to perform a third processing. 

19. An image processing method for processing image 
data by the image processing device according to 
claim 7, the method comprising the steps of: 

40 

receiving image data corresponding to one 
video signal by the input section; 
writing the image data output from the input 
section into the image memory to temporarily 

45 store the image data in the image memory; 

supplying the image data from the input section 
and the image data read from the image mem- 
ory to the digital signal processing section in 
parallel, and performing a predetermined 

so processing between these image data. 

20. An image processing method according to claim 

18, wherein the image data is read from two output 
ports of the image memory by delaying the image 

55 data by a predetermined delay amount and input in 
parallel into the digital signal processing section, 
and the predetermined processing is performed 
between the two units of image data from the image 
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memory and the image data from the input section. 

21. An image processing method for processing image 
data by the image processing device according to 
claim 7, the method comprising the steps of: 

writing only a portion of the image data corre- 
sponding to a portion of pixels for each scan- 
ning line and/or a portion of scanning lines for 
each field among the image data correspond- 
ing to one video signal into the image memory 
to temporarily store the portion of the image 
data in the image memory; and 
reading from the image memory the image 
data in the order in which the pixels and scan- 
ning lines have been written to the image mem- 
ory. 

22. An image processing method for processing image 
data by the image processing device according to 
claim 7, the method comprising the steps of: 

writing image data corresponding to one video 
signal into the image memory to temporarily 
store the image data in the image memory; 
reading the image data from the image mem- 
ory intermittently for each pixel or for each 
scanning line; and 

supplying the image data read from the image 
memory to the digital signal processing sec- 
tion, and interpolating image data at positions 
of pixels or scanning lines which had been 
skipped in the intermittent reading of the image 
memory. 

23. An image processing method for processing image 
data by the image processing device according to 
claim 7, the method comprising the steps of: 

receiving first and second image data units cor- 
responding to two image signals which are 
asynchronous from each other by the input 
section; 

writing the first image data unit output from the 
input section into the image memory to tempo- 
rarily store the first image data in the image 
memory; 

supplying the second image data unit output 
from the input section to the digital signal 
processing section, and simultaneously read- 
ing the first image data unit from the image 
memory to supply to the digital signal process- 
ing section in synchronization with the supply 
of the second image data unit; and 
performing a predetermined processing for the 
first and second image data units input in syn- 
chronization with each other by the digital sig- 
nal processing section. 



24. An image processing method for processing image 
data by the image processing device according to 
claim 7, the method comprising the steps of: 

5 receiving first and second image data units cor- 

responding to two image signals which are 
asynchronous from each other by the input 
section; 

supplying the first image data unit output from 
10 the input section to the digital signal processing 

section to perform a predetermined process- 
ing; 

supplying the first image data unit output from 
the digital signal processing section to the 

15 image memory, and simultaneously supplying 

the second image data unit output from the 
input section to the image memory; and 
reading the first and second image data units 
from the image memory in synchronization with 

20 a synchronous signal other than synchronous 

signals relating to the first and second image 
data units. 

25. An image processing method for processing image 
25 data by the image processing device according to 

claim 7, the method comprising the steps of: 

receiving image data corresponding to one 
video signal by the input section; 

30 supplying a former half of the image data out- 

put from the input section to the digital signal 
processing section during a first period; 
writing the image data output from the input 
section into the image memory and reading the 

35 written image data after a predetermined delay 

time; and 

supplying a latter half of the image data output 
from the image memory to the digital signal 
processing section during a second period. 

40 

26. An image processing method according to claim 
25, further comprising the steps of: 

writing the former half of the image data output 
45 from the digital signal processing section into 

the image memory and reading the written 
image data after a predetermined delay time; 
outputting the former half of the image data 
read from the image memory from the output 
so section; 

outputting the latter half of the image data from 
the digital signal processing section; and 
outputting the latter half of the image data out- 
put from the digital signal processing section 
55 from the output section in succession with the 

former half of the image data. 

27. An image processing method according to claim 
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26, further comprising the steps of: 

adding a first overlap portion which overlaps a 
head portion of the latter half of the image data 
by a predetermined number of pixels to a tail s 
portion of the former half of the image data 
input into the digital signal processing section 
during the first period; 

adding a second overlap portion which over- 
laps a tail portion of the former half of the 10 
image data by a predetermined number of pix- 
els to a head portion of the latter half of the 
image data input into the digital signal process- 
ing section during the second period; and 
removing the first and second overlap portions is 
at a stage of outputting the image data outside 
from the output section. 

28. An image processing method for processing image 
data by the image processing device according to 20 
claim 7, the method comprising the steps of: 

receiving image data corresponding to one 
video signal by the input section and perform- 
ing a low-pass filtering processing by the input 25 
section; and 

supplying the image data output from the input 
section to the digital signal processing section 
or the image memory, and performing a deci- 
mation processing for information compression 30 
of the image data. 

29. A video signal processing device comprising: 

a first converter for receiving a plurality of video 35 
data units corresponding to a plurality of pixels 
connected to one scanning line as an input 
video signal, and converting the plurality of 
video data units into a plurality of video data 
sets, each of the plurality of video data sets 40 
including at least two video data units; 
an operator for processing the plurality of video 
data sets and outputting a plurality of proc- 
essed video data sets; and 
a second converter for converting the plurality 45 
of processed video data sets into a plurality of 
processed video data units corresponding to a 
plurality of pixels connected to one scanning 
line, and outputting the plurality of processed 
video data units as an output video signal. 50 

30. A video signal processing device according to claim 
29, wherein the operator includes a plurality of 
processor elements, and each of the plurality of 
processor elements processes at least two image 55 
data units included in each of the plurality of video 
data sets. 
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